2024-05-06T12:50:06.044 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-06T12:50:06.044 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193 --verbose --owner scheduled_teuthology@teuthology --name teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} -- /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/orig.config.yaml 2024-05-06T12:50:06.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T12:50:06.176 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193 branch: squid description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} email: ceph-qa@ceph.com first_in_suite: false job_id: '7688193' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-only-match: - CEPHADM_ sha1: 70ce9539b62a15b9de429c1f0e91a1e012b099aa ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 70ce9539b62a15b9de429c1f0e91a1e012b099aa workunit: branch: squid sha1: 70ce9539b62a15b9de429c1f0e91a1e012b099aa owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 3735 sha1: 70ce9539b62a15b9de429c1f0e91a1e012b099aa sleep_before_teardown: 0 subset: 10/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_70ce9539b62a15b9de429c1f0e91a1e012b099aa/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 70ce9539b62a15b9de429c1f0e91a1e012b099aa targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbm97ncb9cJfGkvZYwUz2Uv9b1Q2MgKCwVnvAL+DGirCCybZGt/CG1n/tsTKmmr7Ox36DeH+rZ68u8bV6O3CoE= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPE7Vggc8N4pXyvEVqCgh/v1gyAvaNSX2No/OwryBmg+ISqZYMywQMiMc3o8el9uihH+wGfczTIFLfzLNQfjmcE= tasks: - cephadm: cephadm_branch: v17.2.0 cephadm_git_url: https://github.com/ceph/ceph image: quay.io/ceph/ceph:v17.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph orch apply rgw smpl - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_21:08:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-06T12:50:06.177 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_70ce9539b62a15b9de429c1f0e91a1e012b099aa/qa; will attempt to use it 2024-05-06T12:50:06.177 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_70ce9539b62a15b9de429c1f0e91a1e012b099aa/qa/tasks 2024-05-06T12:50:06.177 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-06T12:50:06.179 INFO:teuthology.task.internal:Checking packages... 2024-05-06T12:50:06.205 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '70ce9539b62a15b9de429c1f0e91a1e012b099aa' 2024-05-06T12:50:06.205 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-06T12:50:06.206 INFO:teuthology.packaging:ref: None 2024-05-06T12:50:06.206 INFO:teuthology.packaging:tag: None 2024-05-06T12:50:06.206 INFO:teuthology.packaging:branch: squid 2024-05-06T12:50:06.206 INFO:teuthology.packaging:sha1: 70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T12:50:06.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-05-06T12:50:06.424 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2504.gb05eb275 2024-05-06T12:50:06.426 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-06T12:50:06.433 INFO:teuthology.task.internal:no buildpackages task found 2024-05-06T12:50:06.433 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-06T12:50:06.440 INFO:teuthology.task.internal:Saving configuration 2024-05-06T12:50:06.452 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-06T12:50:06.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T12:50:06.484 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 12:45:01.081448', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbm97ncb9cJfGkvZYwUz2Uv9b1Q2MgKCwVnvAL+DGirCCybZGt/CG1n/tsTKmmr7Ox36DeH+rZ68u8bV6O3CoE='} 2024-05-06T12:50:06.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 12:45:01.079392', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPE7Vggc8N4pXyvEVqCgh/v1gyAvaNSX2No/OwryBmg+ISqZYMywQMiMc3o8el9uihH+wGfczTIFLfzLNQfjmcE='} 2024-05-06T12:50:06.507 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-06T12:50:06.514 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-05-06T12:50:06.514 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-05-06T12:50:06.514 INFO:teuthology.run_tasks:Running task console_log... 2024-05-06T12:50:06.589 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f23c47a60d0>, signals=[15]) 2024-05-06T12:50:06.589 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-06T12:50:06.604 INFO:teuthology.task.internal:Opening connections... 2024-05-06T12:50:06.604 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-05-06T12:50:06.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T12:50:06.683 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-05-06T12:50:06.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T12:50:06.756 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-06T12:50:06.763 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-05-06T12:50:06.781 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-05-06T12:50:06.782 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-06T12:50:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-05-06T12:50:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-05-06T12:50:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-06T12:50:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-05-06T12:50:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-06T12:50:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-06T12:50:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-06T12:50:06.840 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-05-06T12:50:06.861 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-05-06T12:50:06.878 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-05-06T12:50:06.879 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-05-06T12:50:06.935 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-05-06T12:50:06.935 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2024-05-06T12:50:06.935 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-06T12:50:06.936 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-06T12:50:06.936 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-05-06T12:50:06.960 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-06T12:50:06.970 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-06T12:50:06.992 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-06T12:50:06.992 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-05-06T12:50:06.995 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-05-06T12:50:07.011 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-06T12:50:07.017 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-06T12:50:07.017 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-05-06T12:50:07.052 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-05-06T12:50:07.142 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-06T12:50:07.201 INFO:teuthology.run_tasks:Running task kernel... 2024-05-06T12:50:07.220 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-06T12:50:07.220 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-06T12:50:07.221 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T12:50:07.221 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T12:50:07.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T12:50:07.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T12:50:07.240 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-05-06T12:50:07.240 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-05-06T12:50:07.297 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-437.el9.x86_64 2024-05-06T12:50:07.297 INFO:teuthology.task.kernel:Running kernel on smithi186: 5.14.0-437.el9.x86_64 2024-05-06T12:50:07.297 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum install -y kernel 2024-05-06T12:50:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-437.el9.x86_64 2024-05-06T12:50:07.299 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.14.0-437.el9.x86_64 2024-05-06T12:50:07.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2024-05-06T12:50:11.024 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.0 MB 00:01 2024-05-06T12:50:11.488 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-05-06T12:50:13.390 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-06T12:50:14.266 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 19 MB 00:02 2024-05-06T12:50:17.523 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-06T12:50:18.509 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-06T12:50:19.007 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-06T12:50:20.101 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-06T12:50:20.217 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-06T12:50:22.555 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 21 MB 00:02 2024-05-06T12:50:25.526 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-06T12:50:27.473 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-06T12:50:27.474 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-06T12:50:27.579 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-05-06T12:50:27.580 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-05-06T12:50:27.580 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-05-06T12:50:27.664 DEBUG:teuthology.orchestra.run.smithi016:> echo no | sudo yum reinstall kernel || true 2024-05-06T12:50:27.727 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-06T12:50:28.187 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:03 ago on Mon 06 May 2024 12:50:25 PM UTC. 2024-05-06T12:50:28.315 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-05-06T12:50:28.323 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-06T12:50:28.323 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-05-06T12:50:28.323 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-06T12:50:28.323 INFO:teuthology.orchestra.run.smithi016.stdout:Reinstalling: 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 255 k 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 0 2024-05-06T12:50:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:Operation aborted. 2024-05-06T12:50:28.374 INFO:teuthology.orchestra.run.smithi016.stdout:Is this ok [y/N]: 2024-05-06T12:50:28.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum reinstall -y kernel || true 2024-05-06T12:50:28.893 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:03 ago on Mon 06 May 2024 12:50:25 PM UTC. 2024-05-06T12:50:29.014 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-05-06T12:50:29.015 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-06T12:50:29.015 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-05-06T12:50:29.015 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout:Reinstalling: 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 255 k 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 0 2024-05-06T12:50:29.016 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-05-06T12:50:29.228 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-05-06T12:50:29.228 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-05-06T12:50:29.228 INFO:teuthology.orchestra.run.smithi016.stdout:Total 1.2 MB/s | 255 kB 00:00 2024-05-06T12:50:29.245 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-05-06T12:50:29.427 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-05-06T12:50:29.427 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-05-06T12:50:29.432 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-05-06T12:50:29.432 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-05-06T12:50:29.573 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-05-06T12:50:29.592 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-06T12:50:29.592 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-06T12:50:29.645 INFO:teuthology.orchestra.run.smithi016.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T12:50:29.645 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T12:50:29.683 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-05-06T12:50:29.684 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-05-06T12:50:29.684 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-05-06T12:50:29.802 DEBUG:teuthology.orchestra.run.smithi186:> echo no | sudo yum reinstall kernel || true 2024-05-06T12:50:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T12:50:30.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T12:50:30.344 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:00:03 ago on Mon 06 May 2024 12:50:27 PM UTC. 2024-05-06T12:50:30.485 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-05-06T12:50:30.492 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-05-06T12:50:30.492 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:Reinstalling: 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 255 k 2024-05-06T12:50:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 0 2024-05-06T12:50:30.494 INFO:teuthology.orchestra.run.smithi186.stderr:Operation aborted. 2024-05-06T12:50:30.554 INFO:teuthology.orchestra.run.smithi186.stdout:Is this ok [y/N]: 2024-05-06T12:50:30.554 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum reinstall -y kernel || true 2024-05-06T12:50:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T12:50:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:50:30.989 INFO:teuthology.orchestra.run.smithi016.stdout:Reinstalled: 2024-05-06T12:50:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-5.14.0-437.el9.x86_64 2024-05-06T12:50:30.990 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:50:30.990 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-05-06T12:50:31.053 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:00:04 ago on Mon 06 May 2024 12:50:27 PM UTC. 2024-05-06T12:50:31.156 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T12:50:31.169 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-05-06T12:50:31.169 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout:Reinstalling: 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-05-06T12:50:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:50:31.171 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 255 k 2024-05-06T12:50:31.171 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 0 2024-05-06T12:50:31.171 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-05-06T12:50:31.203 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-437.el9.x86_64 2024-05-06T12:50:31.204 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-05-06T12:50:31.204 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-06T12:50:31.204 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-06T12:50:31.204 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T12:50:31.242 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-05-06T12:50:31.269 DEBUG:teuthology.parallel:result is None 2024-05-06T12:50:31.488 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.3 MB/s | 255 kB 00:00 2024-05-06T12:50:31.488 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-05-06T12:50:31.488 INFO:teuthology.orchestra.run.smithi186.stdout:Total 803 kB/s | 255 kB 00:00 2024-05-06T12:50:31.505 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-05-06T12:50:31.727 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-05-06T12:50:31.728 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-05-06T12:50:31.732 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-05-06T12:50:31.733 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-05-06T12:50:31.854 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-05-06T12:50:31.939 INFO:teuthology.orchestra.run.smithi186.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T12:50:31.939 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T12:50:32.582 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T12:50:32.582 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-06T12:50:33.287 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-06T12:50:33.287 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:50:33.287 INFO:teuthology.orchestra.run.smithi186.stdout:Reinstalled: 2024-05-06T12:50:33.287 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-5.14.0-437.el9.x86_64 2024-05-06T12:50:33.287 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:50:33.287 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-05-06T12:50:33.474 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-05-06T12:50:33.520 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-437.el9.x86_64 2024-05-06T12:50:33.521 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-05-06T12:50:33.521 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-06T12:50:33.521 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-06T12:50:33.521 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T12:50:33.554 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2024-05-06T12:50:33.574 DEBUG:teuthology.parallel:result is None 2024-05-06T12:50:33.574 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-06T12:50:33.583 INFO:teuthology.task.internal:Creating test directory... 2024-05-06T12:50:33.583 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T12:50:33.585 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T12:50:33.629 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-06T12:50:33.640 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-06T12:50:33.654 INFO:teuthology.task.internal:Creating archive directory... 2024-05-06T12:50:33.654 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T12:50:33.656 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T12:50:33.694 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-06T12:50:33.705 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-06T12:50:33.706 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T12:50:33.720 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T12:50:33.752 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T12:50:33.763 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T12:50:33.773 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T12:50:33.782 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T12:50:33.784 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-06T12:50:33.795 INFO:teuthology.task.internal:Configuring sudo... 2024-05-06T12:50:33.795 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T12:50:33.808 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T12:50:33.848 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-06T12:50:33.860 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-06T12:50:33.861 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T12:50:33.876 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T12:50:33.903 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T12:50:33.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T12:50:34.026 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T12:50:34.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T12:50:34.151 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:50:34.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T12:50:34.217 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T12:50:34.259 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T12:50:34.306 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T12:50:34.389 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T12:50:34.426 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T12:50:34.427 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T12:50:34.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-05-06T12:50:34.492 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-05-06T12:50:34.522 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T12:50:34.574 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T12:50:35.053 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-06T12:50:35.069 INFO:teuthology.task.internal:Starting timer... 2024-05-06T12:50:35.070 INFO:teuthology.run_tasks:Running task pcp... 2024-05-06T12:50:35.083 INFO:teuthology.run_tasks:Running task selinux... 2024-05-06T12:50:35.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-05-06T12:50:35.163 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-05-06T12:50:35.165 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-05-06T12:50:35.218 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-05-06T12:50:35.220 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-06T12:50:35.220 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-05-06T12:50:35.245 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-05-06T12:50:35.245 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-05-06T12:50:35.263 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-05-06T12:50:35.264 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2024-05-06T12:50:35.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-06T12:50:35.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T12:50:35.310 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-06T12:50:35.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T12:50:35.335 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-06T12:50:35.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-05-06T12:50:35.375 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-05-06T12:50:35.399 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-06T12:50:35.410 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-06T12:50:35.428 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-06T12:50:35.430 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-06T12:54:28.848 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-05-06T12:54:28.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-06T12:54:28.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T12:54:28.928 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-05-06T12:54:29.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-06T12:54:29.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-05-06T12:54:29.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T12:54:29.080 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-05-06T12:54:29.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-05-06T12:54:29.175 INFO:teuthology.run_tasks:Running task clock... 2024-05-06T12:54:29.186 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-06T12:54:29.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T12:54:29.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T12:54:29.189 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T12:54:29.190 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T12:54:29.218 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-06T12:54:29.233 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-06T12:54:29.246 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-06T12:54:29.257 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-05-06T12:54:29.258 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-06T12:54:29.270 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-05-06T12:54:29.281 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-05-06T12:54:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-06T12:54:29.292 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-05-06T12:54:29.296 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-06T12:54:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-06T12:54:29.317 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-06T12:54:29.352 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-05-06T12:54:29.356 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T12:54:29.356 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-05-06T12:54:29.356 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.356 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.356 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.356 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.373 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-05-06T12:54:29.377 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T12:54:29.377 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-05-06T12:54:29.377 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.377 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.377 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.377 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T12:54:29.377 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-06T12:54:29.480 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v17.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'quay.io/ceph/ceph:v17.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': '70ce9539b62a15b9de429c1f0e91a1e012b099aa'} 2024-05-06T12:54:29.480 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v17.2.0 2024-05-06T12:54:29.481 INFO:tasks.cephadm:Cluster fsid is c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:54:29.481 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-06T12:54:29.481 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.16', 'mon.c': '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]', 'mon.b': '172.21.15.186'} 2024-05-06T12:54:29.481 INFO:tasks.cephadm:First mon is mon.a on smithi016 2024-05-06T12:54:29.481 INFO:tasks.cephadm:First mgr is y 2024-05-06T12:54:29.481 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-06T12:54:29.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname $(hostname -s) 2024-05-06T12:54:29.507 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname $(hostname -s) 2024-05-06T12:54:29.532 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v17.2.0)... 2024-05-06T12:54:29.532 DEBUG:teuthology.orchestra.run.smithi016:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-06T12:54:29.928 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 May 6 12:54 /home/ubuntu/cephtest/cephadm 2024-05-06T12:54:29.929 DEBUG:teuthology.orchestra.run.smithi186:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-06T12:54:30.162 INFO:teuthology.orchestra.run.smithi186.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 May 6 12:54 /home/ubuntu/cephtest/cephadm 2024-05-06T12:54:30.162 DEBUG:teuthology.orchestra.run.smithi016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-06T12:54:30.180 DEBUG:teuthology.orchestra.run.smithi186:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-06T12:54:30.206 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v17.2.0 on all hosts... 2024-05-06T12:54:30.206 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-05-06T12:54:30.222 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-05-06T12:54:31.723 INFO:teuthology.orchestra.run.smithi186.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-05-06T12:54:31.763 INFO:teuthology.orchestra.run.smithi016.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout: "repo_digests": [ 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-05-06T12:54:59.298 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "repo_digests": [ 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-05-06T12:55:00.048 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-06T12:55:00.049 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T12:55:00.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph 2024-05-06T12:55:00.115 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph 2024-05-06T12:55:00.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /etc/ceph 2024-05-06T12:55:00.171 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /etc/ceph 2024-05-06T12:55:00.213 INFO:tasks.cephadm:Writing seed config... 2024-05-06T12:55:00.214 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-05-06T12:55:00.214 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-06T12:55:00.214 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-06T12:55:00.215 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-05-06T12:55:00.215 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-06T12:55:00.215 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-06T12:55:00.215 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-06T12:55:00.215 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-06T12:55:00.215 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-06T12:55:00.215 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:55:00.215 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-06T12:55:00.230 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c6d11770-0ba7-11ef-bc97-c7b262605968 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-05-06T12:55:00.231 DEBUG:teuthology.orchestra.run.smithi016:mon.a> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service 2024-05-06T12:55:00.273 DEBUG:teuthology.orchestra.run.smithi016:mgr.y> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service 2024-05-06T12:55:00.316 INFO:tasks.cephadm:Bootstrapping... 2024-05-06T12:55:00.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 -v bootstrap --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.16 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-06T12:55:00.515 INFO:teuthology.orchestra.run.smithi016.stderr:-------------------------------------------------------------------------------- 2024-05-06T12:55:00.515 INFO:teuthology.orchestra.run.smithi016.stderr:cephadm ['--image', 'quay.io/ceph/ceph:v17.2.0', '-v', 'bootstrap', '--fsid', 'c6d11770-0ba7-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.16', '--skip-admin-label'] 2024-05-06T12:55:00.547 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: 4.9.4-dev 2024-05-06T12:55:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:Verifying podman|docker is present... 2024-05-06T12:55:00.572 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: 4.9.4-dev 2024-05-06T12:55:00.574 INFO:teuthology.orchestra.run.smithi016.stderr:Verifying lvm2 is present... 2024-05-06T12:55:00.574 INFO:teuthology.orchestra.run.smithi016.stderr:Verifying time synchronization is in place... 2024-05-06T12:55:00.581 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-05-06T12:55:00.587 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: inactive 2024-05-06T12:55:00.594 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: enabled 2024-05-06T12:55:00.600 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: active 2024-05-06T12:55:00.600 INFO:teuthology.orchestra.run.smithi016.stderr:Unit chronyd.service is enabled and running 2024-05-06T12:55:00.600 INFO:teuthology.orchestra.run.smithi016.stderr:Repeating the final host check... 2024-05-06T12:55:00.621 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: 4.9.4-dev 2024-05-06T12:55:00.624 INFO:teuthology.orchestra.run.smithi016.stderr:podman (/bin/podman) version 4.9.4 is present 2024-05-06T12:55:00.624 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl is present 2024-05-06T12:55:00.624 INFO:teuthology.orchestra.run.smithi016.stderr:lvcreate is present 2024-05-06T12:55:00.630 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-05-06T12:55:00.636 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: inactive 2024-05-06T12:55:00.642 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: enabled 2024-05-06T12:55:00.648 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: active 2024-05-06T12:55:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:Unit chronyd.service is enabled and running 2024-05-06T12:55:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:Host looks OK 2024-05-06T12:55:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:Cluster fsid: c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:Acquiring lock 140596365459312 on /run/cephadm/c6d11770-0ba7-11ef-bc97-c7b262605968.lock 2024-05-06T12:55:00.649 INFO:teuthology.orchestra.run.smithi016.stderr:Lock 140596365459312 acquired on /run/cephadm/c6d11770-0ba7-11ef-bc97-c7b262605968.lock 2024-05-06T12:55:00.650 INFO:teuthology.orchestra.run.smithi016.stderr:Verifying IP 172.21.15.16 port 3300 ... 2024-05-06T12:55:00.650 INFO:teuthology.orchestra.run.smithi016.stderr:Verifying IP 172.21.15.16 port 6789 ... 2024-05-06T12:55:00.650 INFO:teuthology.orchestra.run.smithi016.stderr:Base mon IP is 172.21.15.16, final addrv is [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-05-06T12:55:00.652 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.16 metric 100 2024-05-06T12:55:00.652 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.16 metric 100 2024-05-06T12:55:00.655 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-05-06T12:55:00.655 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-06T12:55:00.655 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-06T12:55:00.658 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-06T12:55:00.658 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-05-06T12:55:00.658 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-05-06T12:55:00.658 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-06T12:55:00.658 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-05-06T12:55:00.658 INFO:teuthology.orchestra.run.smithi016.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-05-06T12:55:00.659 INFO:teuthology.orchestra.run.smithi016.stderr:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-05-06T12:55:00.659 INFO:teuthology.orchestra.run.smithi016.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-06T12:55:00.659 INFO:teuthology.orchestra.run.smithi016.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-05-06T12:55:00.765 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Trying to pull quay.io/ceph/ceph:v17.2.0... 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Getting image source signatures 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Copying blob sha256:a70843738bb77e1ab9c1f85969ebdfa55f178e746be081d1cb4f94011f69eb7c 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Copying blob sha256:c32ab78b488d0c72f64eded765c0cf6b5bf2c75dab66cb62a9d367fa6ec42513 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Copying blob sha256:599d07cb321ff0a3c82224e1138fc685793fa69b93ed5780415751a5f7e4b8c2 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Copying blob sha256:33ca8fff7868c4dc0c11e09bca97c720eb9cfbab7221216754367dd8de70388a 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Copying blob sha256:89b4a75bc2d8500f15463747507c9623df43886c134463e7f0527e70900e7a7b 2024-05-06T12:55:01.267 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Copying config sha256:e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-05-06T12:55:01.577 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: Writing manifest to image destination 2024-05-06T12:55:01.730 INFO:teuthology.orchestra.run.smithi016.stderr:/bin/podman: e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-05-06T12:55:02.140 INFO:teuthology.orchestra.run.smithi016.stderr:ceph: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-05-06T12:55:02.621 INFO:teuthology.orchestra.run.smithi016.stderr:Ceph version: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-05-06T12:55:02.621 INFO:teuthology.orchestra.run.smithi016.stderr:Extracting ceph user uid/gid from container image... 2024-05-06T12:55:03.053 INFO:teuthology.orchestra.run.smithi016.stderr:stat: 167 167 2024-05-06T12:55:03.627 INFO:teuthology.orchestra.run.smithi016.stderr:Creating initial keys... 2024-05-06T12:55:04.034 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph-authtool: AQAn0zhmqEUzORAAdDsWgqMBdoVSxp5ArT/0GA== 2024-05-06T12:55:04.975 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph-authtool: AQAo0zhm1X+SNxAAt8wVYgV+w9y2cxXdSUXidg== 2024-05-06T12:55:05.847 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph-authtool: AQAp0zhm2lFuLRAA8vkNxGiaBf2Le0QoRhkNgw== 2024-05-06T12:55:06.446 INFO:teuthology.orchestra.run.smithi016.stderr:Creating initial monmap... 2024-05-06T12:55:06.878 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-06T12:55:06.878 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2024-05-06T12:55:06.878 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:06.878 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-06T12:55:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:monmaptool for a [v2:172.21.15.16:3300,v1:172.21.15.16:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-06T12:55:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:setting min_mon_release = octopus 2024-05-06T12:55:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/monmaptool: set fsid to c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:07.377 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-06T12:55:07.377 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:55:07.377 INFO:teuthology.orchestra.run.smithi016.stderr:Creating mon... 2024-05-06T12:55:08.365 INFO:teuthology.orchestra.run.smithi016.stderr:create mon.a on 2024-05-06T12:55:08.593 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-06T12:55:08.756 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968.target. 2024-05-06T12:55:08.756 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968.target. 2024-05-06T12:55:09.072 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Failed to reset failed state of unit ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-06T12:55:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Created symlink /etc/systemd/system/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968.target.wants/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@.service. 2024-05-06T12:55:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 podman[22057]: 2024-05-06 12:55:09.397936695 +0000 UTC m=+0.019018748 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-05-06T12:55:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: disabled 2024-05-06T12:55:09.761 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: inactive 2024-05-06T12:55:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:firewalld.service is not enabled 2024-05-06T12:55:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:Not possible to enable service . firewalld.service is not available 2024-05-06T12:55:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for mon to start... 2024-05-06T12:55:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for mon... 2024-05-06T12:55:09.884 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 podman[22057]: 2024-05-06 12:55:09.657477774 +0000 UTC m=+0.278559827 container init 8a5a996671d0a9a78ee5912bbd1aebb43591ffc0a6638024b0e924636141eef4 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.19.8, GIT_CLEAN=True, version=8, com.redhat.component=centos-stream-container, RELEASE=HEAD, release=754, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, name=centos-stream) 2024-05-06T12:55:09.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 podman[22057]: 2024-05-06 12:55:09.660582051 +0000 UTC m=+0.281664104 container start 8a5a996671d0a9a78ee5912bbd1aebb43591ffc0a6638024b0e924636141eef4 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, RELEASE=HEAD, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, vcs-type=git, io.openshift.expose-services=, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, io.buildah.version=1.19.8) 2024-05-06T12:55:09.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 ceph-mon[22075]: mkfs c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:09.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 ceph-mon[22075]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-06T12:55:09.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 bash[22057]: 8a5a996671d0a9a78ee5912bbd1aebb43591ffc0a6638024b0e924636141eef4 2024-05-06T12:55:09.885 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:09 smithi016 systemd[1]: Started Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T12:55:10.263 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: cluster: 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: id: c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: services: 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.5637s) 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mgr: no daemons active 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: data: 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: pgs: 2024-05-06T12:55:10.264 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:10.809 INFO:teuthology.orchestra.run.smithi016.stderr:mon is available 2024-05-06T12:55:10.809 INFO:teuthology.orchestra.run.smithi016.stderr:Assimilating anything we can from ceph.conf... 2024-05-06T12:55:10.915 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:10 smithi016 ceph-mon[22075]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-06T12:55:10.915 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:10 smithi016 ceph-mon[22075]: monmap e1: 1 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0]} 2024-05-06T12:55:10.915 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:10 smithi016 ceph-mon[22075]: fsmap 2024-05-06T12:55:10.915 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:10 smithi016 ceph-mon[22075]: osdmap e1: 0 total, 0 up, 0 in 2024-05-06T12:55:10.915 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:10 smithi016 ceph-mon[22075]: mgrmap e1: no daemons active 2024-05-06T12:55:10.916 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:10 smithi016 ceph-mon[22075]: from='client.? 172.21.15.16:0/294770289' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-06T12:55:11.333 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:11.333 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: [global] 2024-05-06T12:55:11.333 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: fsid = c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:11.333 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: [mgr] 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mgr/cephadm/use_agent = True 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: [osd] 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-05-06T12:55:11.334 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-05-06T12:55:11.879 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:11 smithi016 ceph-mon[22075]: from='client.? 172.21.15.16:0/146729089' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-06T12:55:11.879 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:11 smithi016 ceph-mon[22075]: from='client.? 172.21.15.16:0/146729089' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-06T12:55:11.882 INFO:teuthology.orchestra.run.smithi016.stderr:Generating new minimal ceph.conf... 2024-05-06T12:55:12.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:12 smithi016 ceph-mon[22075]: from='client.? 172.21.15.16:0/2116744658' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:55:12.930 INFO:teuthology.orchestra.run.smithi016.stderr:Restarting the monitor... 2024-05-06T12:55:13.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:12 smithi016 systemd[1]: Stopping Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T12:55:13.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:12 smithi016 bash[22294]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon.a" found: no such container 2024-05-06T12:55:13.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a[22071]: 2024-05-06T12:55:13.096+0000 7f58848a4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T12:55:13.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a[22071]: 2024-05-06T12:55:13.096+0000 7f58848a4700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-06T12:55:13.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 podman[22305]: 2024-05-06 12:55:13.137403065 +0000 UTC m=+0.147343702 container died 8a5a996671d0a9a78ee5912bbd1aebb43591ffc0a6638024b0e924636141eef4 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, version=8, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, io.openshift.expose-services=, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, GIT_BRANCH=HEAD, release=754, vendor=Red Hat, Inc., RELEASE=HEAD) 2024-05-06T12:55:13.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 podman[22305]: 2024-05-06 12:55:13.49579695 +0000 UTC m=+0.505737585 container cleanup 8a5a996671d0a9a78ee5912bbd1aebb43591ffc0a6638024b0e924636141eef4 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.19.8, distribution-scope=public, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, version=8, build-date=2022-05-03T08:36:31.336870, ceph=True, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, name=centos-stream, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, release=754) 2024-05-06T12:55:13.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 bash[22305]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a 2024-05-06T12:55:13.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 bash[22332]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon.a" found: no such container 2024-05-06T12:55:14.015 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 podman[22317]: 2024-05-06 12:55:13.763504464 +0000 UTC m=+0.626881854 container remove 8a5a996671d0a9a78ee5912bbd1aebb43591ffc0a6638024b0e924636141eef4 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, vendor=Red Hat, Inc., io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vcs-type=git, architecture=x86_64, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, distribution-scope=public, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream) 2024-05-06T12:55:14.015 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-06T12:55:14.015 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 systemd[1]: Stopped Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T12:55:14.015 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:13 smithi016 systemd[1]: Starting Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T12:55:14.015 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 podman[22401]: 2024-05-06 12:55:13.910889036 +0000 UTC m=+0.019550329 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-05-06T12:55:14.015 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 podman[22401]: 2024-05-06 12:55:14.014320223 +0000 UTC m=+0.122981502 container create a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, ceph=True, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., vcs-type=git, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, io.buildah.version=1.19.8, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 podman[22401]: 2024-05-06 12:55:14.23413339 +0000 UTC m=+0.342794669 container init a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, vcs-type=git, name=centos-stream, distribution-scope=public, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, release=754, RELEASE=HEAD, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux ) 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 podman[22401]: 2024-05-06 12:55:14.237243961 +0000 UTC m=+0.345905238 container start a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, release=754, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., io.openshift.expose-services=, version=8, io.buildah.version=1.19.8, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git) 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: pidfile_write: ignore empty --pid-file 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: load: jerasure load: lrc 2024-05-06T12:55:14.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: RocksDB version: 6.15.5 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Compile date Apr 18 2022 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: DB SUMMARY 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: DB Session ID: F16IB50FG2FHZLNR6HVH 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: CURRENT file: CURRENT 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-06T12:55:14.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82623 ; 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.error_if_exists: 0 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.create_if_missing: 0 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.paranoid_checks: 1 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.env: 0x55b0c9ac6860 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.fs: Posix File System 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.info_log: 0x55b0ca391dc0 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.statistics: (nil) 2024-05-06T12:55:14.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.use_fsync: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_log_file_size: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.allow_fallocate: 1 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.use_direct_reads: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T12:55:14.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.db_log_dir: 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T12:55:14.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.write_buffer_manager: 0x55b0ca4822a0 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T12:55:14.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.unordered_write: 0 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.row_cache: None 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.wal_filter: None 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T12:55:14.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.preserve_deletes: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.two_write_queues: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.atomic_flush: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.log_readahead_size: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T12:55:14.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_background_jobs: 2 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_background_compactions: -1 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_subcompactions: 1 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_open_files: -1 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T12:55:14.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_background_flushes: -1 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Compression algorithms supported: 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kZSTD supported: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kXpressCompression supported: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kLZ4Compression supported: 1 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kBZip2Compression supported: 0 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kZlibCompression supported: 1 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: kSnappyCompression supported: 1 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-05-06T12:55:14.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.merge_operator: 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_filter: None 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b0ca35dd00) 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_type: 0 2024-05-06T12:55:14.276 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_index_type: 0 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_shortening: 1 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: hash_index_allow_collision: 1 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: checksum: 1 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: no_block_cache: 0 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache: 0x55b0ca3c8170 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_options: 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: capacity : 536870912 2024-05-06T12:55:14.277 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_shard_bits : 4 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: strict_capacity_limit : 0 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_compressed: (nil) 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: persistent_cache: (nil) 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size: 4096 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size_deviation: 10 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_restart_interval: 16 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_block_restart_interval: 1 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: metadata_block_size: 4096 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: partition_filters: 0 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: use_delta_encoding: 1 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: whole_key_filtering: 1 2024-05-06T12:55:14.278 INFO:journalctl@ceph.mon.a.smithi016.stdout: verify_compression: 0 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout: format_version: 4 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_index_compression: 1 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_align: 0 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression: NoCompression 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.num_levels: 7 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T12:55:14.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T12:55:14.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T12:55:14.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.arena_block_size: 4194304 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T12:55:14.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.table_properties_collectors: 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.inplace_update_support: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.bloom_locality: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.max_successive_merges: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.ttl: 2592000 2024-05-06T12:55:14.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.enable_blob_files: false 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.min_blob_size: 0 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000114263468, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000114264300, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79173, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77436, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10027, "raw_average_key_size": 47, "raw_value_size": 71745, "raw_average_value_size": 340, "num_data_blocks": 10, "num_entries": 211, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1715000114, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "91dcdf0e-aa05-4153-8aee-3ede9bea5d75", "db_session_id": "F16IB50FG2FHZLNR6HVH"}} 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2024-05-06T12:55:14.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000114264641, "job": 1, "event": "recovery_finished"} 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55b0ca3aea80 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: DB pointer 0x55b0ca3be000 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** DB Stats ** 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.285 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: L0 2/0 79.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: Sum 2/0 79.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.286 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T12:55:14.287 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative compaction: 0.00 GB write, 23.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval compaction: 0.00 GB write, 23.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T12:55:14.288 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: L0 2/0 79.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: Sum 2/0 79.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T12:55:14.289 INFO:journalctl@ceph.mon.a.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.8 0.00 0.00 1 0.001 0 0 2024-05-06T12:55:14.290 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T12:55:14.290 INFO:journalctl@ceph.mon.a.smithi016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-06T12:55:14.290 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T12:55:14.290 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T12:55:14.290 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T12:55:14.290 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative compaction: 0.00 GB write, 23.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: starting mon.a rank 0 at public addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] at bind addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:14.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???) e1 preinit fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:14.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).mds e1 new map 2024-05-06T12:55:14.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).mds e1 print_map 2024-05-06T12:55:14.292 INFO:journalctl@ceph.mon.a.smithi016.stdout: e1 2024-05-06T12:55:14.292 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T12:55:14.292 INFO:journalctl@ceph.mon.a.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T12:55:14.292 INFO:journalctl@ceph.mon.a.smithi016.stdout: legacy client fscid: -1 2024-05-06T12:55:14.293 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T12:55:14.293 INFO:journalctl@ceph.mon.a.smithi016.stdout: No filesystems configured 2024-05-06T12:55:14.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-06T12:55:14.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T12:55:14.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T12:55:14.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-06T12:55:14.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-06T12:55:14.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expand map: {default=false} 2024-05-06T12:55:14.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta from 'false' to 'false' 2024-05-06T12:55:14.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expanded map: {default=false} 2024-05-06T12:55:14.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expand map: {default=info} 2024-05-06T12:55:14.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta from 'info' to 'info' 2024-05-06T12:55:14.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expanded map: {default=info} 2024-05-06T12:55:14.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expand map: {default=daemon} 2024-05-06T12:55:14.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta from 'daemon' to 'daemon' 2024-05-06T12:55:14.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expanded map: {default=daemon} 2024-05-06T12:55:14.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expand map: {default=debug} 2024-05-06T12:55:14.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta from 'debug' to 'debug' 2024-05-06T12:55:14.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: expand_channel_meta expanded map: {default=debug} 2024-05-06T12:55:14.316 INFO:teuthology.orchestra.run.smithi016.stderr:Setting mon public_network to 172.21.0.0/20 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 bash[22401]: a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 systemd[1]: Started Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: monmap e1: 1 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0]} 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: fsmap 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: osdmap e1: 0 total, 0 up, 0 in 2024-05-06T12:55:14.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:14 smithi016 ceph-mon[22420]: mgrmap e1: no daemons active 2024-05-06T12:55:15.419 INFO:teuthology.orchestra.run.smithi016.stderr:Wrote config to /etc/ceph/ceph.conf 2024-05-06T12:55:15.419 INFO:teuthology.orchestra.run.smithi016.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-06T12:55:15.419 INFO:teuthology.orchestra.run.smithi016.stderr:Creating mgr... 2024-05-06T12:55:15.420 INFO:teuthology.orchestra.run.smithi016.stderr:Verifying port 9283 ... 2024-05-06T12:55:15.609 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Failed to reset failed state of unit ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Unit ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service not loaded. 2024-05-06T12:55:15.616 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: Created symlink /etc/systemd/system/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968.target.wants/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@.service. 2024-05-06T12:55:15.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:15 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2961471908' entity='client.admin' 2024-05-06T12:55:16.318 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 podman[22633]: 2024-05-06 12:55:16.220384447 +0000 UTC m=+0.338038408 container start df15cc29df076ea1e95c4728064d34600d1722b804dcb5c27d56fa7a26e1d195 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, ceph=True, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, io.openshift.expose-services=, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, release=754, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, vcs-type=git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T12:55:16.331 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: disabled 2024-05-06T12:55:16.338 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: inactive 2024-05-06T12:55:16.339 INFO:teuthology.orchestra.run.smithi016.stderr:firewalld.service is not enabled 2024-05-06T12:55:16.339 INFO:teuthology.orchestra.run.smithi016.stderr:Not possible to enable service . firewalld.service is not available 2024-05-06T12:55:16.348 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: disabled 2024-05-06T12:55:16.355 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: inactive 2024-05-06T12:55:16.356 INFO:teuthology.orchestra.run.smithi016.stderr:firewalld.service is not enabled 2024-05-06T12:55:16.356 INFO:teuthology.orchestra.run.smithi016.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-05-06T12:55:16.356 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for mgr to start... 2024-05-06T12:55:16.356 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for mgr... 2024-05-06T12:55:16.583 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 bash[22633]: df15cc29df076ea1e95c4728064d34600d1722b804dcb5c27d56fa7a26e1d195 2024-05-06T12:55:16.583 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 systemd[1]: Started Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T12:55:16.583 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:16.367+0000 7feae24bd000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T12:55:16.583 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:16.502+0000 7feae24bd000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:55:16.885 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:16.607+0000 7feae24bd000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T12:55:16.888 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:16.888 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:16.888 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsid": "c6d11770-0ba7-11ef-bc97-c7b262605968", 2024-05-06T12:55:16.888 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "health": { 2024-05-06T12:55:16.888 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "checks": {}, 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mutes": [] 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum": [ 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 0 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "a" 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "monmap": { 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-06T12:55:16.889 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osdmap": { 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-06T12:55:16.890 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-06T12:55:16.894 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-06T12:55:16.894 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-06T12:55:16.894 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgmap": { 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsmap": { 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-06T12:55:16.895 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "available": false, 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modules": [ 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "iostat", 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "nfs", 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "restful" 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "servicemap": { 2024-05-06T12:55:16.896 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:16.897 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modified": "2024-05-06T12:55:09.698238+0000", 2024-05-06T12:55:16.897 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:16.897 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:16.897 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-06T12:55:16.897 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:16 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/39388328' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T12:55:17.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:16.935+0000 7feae24bd000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T12:55:17.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:17.020+0000 7feae24bd000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T12:55:17.377 INFO:teuthology.orchestra.run.smithi016.stderr:mgr not available, waiting (1/15)... 2024-05-06T12:55:18.638 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:18.203+0000 7feae24bd000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T12:55:18.639 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:18.370+0000 7feae24bd000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T12:55:18.639 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:18.453+0000 7feae24bd000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T12:55:18.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:18.781+0000 7feae24bd000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T12:55:18.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:18.873+0000 7feae24bd000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T12:55:19.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:18.967+0000 7feae24bd000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T12:55:19.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:19.215+0000 7feae24bd000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:55:19.794 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:19.677+0000 7feae24bd000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T12:55:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsid": "c6d11770-0ba7-11ef-bc97-c7b262605968", 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "health": { 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "checks": {}, 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mutes": [] 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum": [ 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 0 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "a" 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_age": 5, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "monmap": { 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osdmap": { 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-06T12:55:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-06T12:55:19.905 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgmap": { 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsmap": { 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "available": false, 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modules": [ 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "iostat", 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "nfs", 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "restful" 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "servicemap": { 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modified": "2024-05-06T12:55:09.698238+0000", 2024-05-06T12:55:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-06T12:55:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:20 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3544739470' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T12:55:20.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:20.191+0000 7feae24bd000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T12:55:20.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:20.287+0000 7feae24bd000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T12:55:20.454 INFO:teuthology.orchestra.run.smithi016.stderr:mgr not available, waiting (2/15)... 2024-05-06T12:55:20.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:20.591+0000 7feae24bd000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T12:55:20.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:20.682+0000 7feae24bd000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T12:55:21.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:21.095+0000 7feae24bd000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T12:55:21.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:21.231+0000 7feae24bd000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T12:55:21.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:21.325+0000 7feae24bd000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T12:55:21.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:21.442+0000 7feae24bd000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T12:55:21.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:21.533+0000 7feae24bd000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T12:55:22.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:22.098+0000 7feae24bd000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T12:55:22.759 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:22.472+0000 7feae24bd000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T12:55:22.759 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: Activating manager daemon y 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: mgrmap e2: y(active, starting, since 0.00305964s) 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T12:55:22.760 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: Manager daemon y is now available 2024-05-06T12:55:22.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:55:22.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:55:22.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' 2024-05-06T12:55:22.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' 2024-05-06T12:55:22.761 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:22 smithi016 ceph-mon[22420]: from='mgr.14100 172.21.15.16:0/1386806122' entity='mgr.y' 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsid": "c6d11770-0ba7-11ef-bc97-c7b262605968", 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "health": { 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "checks": {}, 2024-05-06T12:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mutes": [] 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum": [ 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 0 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "a" 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_age": 8, 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "monmap": { 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osdmap": { 2024-05-06T12:55:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-06T12:55:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-06T12:55:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-06T12:55:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-06T12:55:22.942 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-06T12:55:22.942 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-06T12:55:22.942 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.942 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgmap": { 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsmap": { 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-06T12:55:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "available": false, 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modules": [ 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "iostat", 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "nfs", 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "restful" 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "servicemap": { 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modified": "2024-05-06T12:55:09.698238+0000", 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-06T12:55:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:23.497 INFO:teuthology.orchestra.run.smithi016.stderr:mgr not available, waiting (3/15)... 2024-05-06T12:55:23.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:23 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/218768492' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T12:55:23.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:23 smithi016 ceph-mon[22420]: mgrmap e3: y(active, since 1.00666s) 2024-05-06T12:55:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:26 smithi016 ceph-mon[22420]: mgrmap e4: y(active, since 2s) 2024-05-06T12:55:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:29 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3148163942' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-06T12:55:29.652 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:29.652 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:29.652 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsid": "c6d11770-0ba7-11ef-bc97-c7b262605968", 2024-05-06T12:55:29.652 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "health": { 2024-05-06T12:55:29.652 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "checks": {}, 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mutes": [] 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum": [ 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 0 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:29.653 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "a" 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "quorum_age": 14, 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "monmap": { 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-06T12:55:29.654 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osdmap": { 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgmap": { 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-06T12:55:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "fsmap": { 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "available": true, 2024-05-06T12:55:29.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-06T12:55:29.658 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modules": [ 2024-05-06T12:55:29.658 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "iostat", 2024-05-06T12:55:29.658 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "nfs", 2024-05-06T12:55:29.658 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "restful" 2024-05-06T12:55:29.658 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ], 2024-05-06T12:55:29.658 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "servicemap": { 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "modified": "2024-05-06T12:55:09.698238+0000", 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "services": {} 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: }, 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-06T12:55:29.659 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:32.002 INFO:teuthology.orchestra.run.smithi016.stderr:mgr is available 2024-05-06T12:55:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: [global] 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: fsid = c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: [mgr] 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: [osd] 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-05-06T12:55:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-05-06T12:55:32.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:32 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3597418701' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-06T12:55:32.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:32 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3597418701' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-06T12:55:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:Enabling cephadm module... 2024-05-06T12:55:34.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:33 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1751628621' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-06T12:55:34.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setuser ceph since I am not root 2024-05-06T12:55:34.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setgroup ceph since I am not root 2024-05-06T12:55:34.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:34.055+0000 7fe2c9b03000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T12:55:34.471 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:34.191+0000 7fe2c9b03000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:55:34.471 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:34.294+0000 7fe2c9b03000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T12:55:34.722 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:34.616+0000 7fe2c9b03000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T12:55:34.722 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:34.702+0000 7fe2c9b03000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T12:55:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:34 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1751628621' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-06T12:55:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:34 smithi016 ceph-mon[22420]: mgrmap e5: y(active, since 11s) 2024-05-06T12:55:35.179 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:35.179 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 5, 2024-05-06T12:55:35.180 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "available": true, 2024-05-06T12:55:35.180 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "active_name": "y", 2024-05-06T12:55:35.180 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_standby": 0 2024-05-06T12:55:35.180 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for the mgr to restart... 2024-05-06T12:55:35.772 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for mgr epoch 5... 2024-05-06T12:55:36.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:35 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2687046611' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-06T12:55:36.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:35 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:35.921+0000 7fe2c9b03000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T12:55:36.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:36.093+0000 7fe2c9b03000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T12:55:36.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:36.178+0000 7fe2c9b03000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T12:55:36.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:36.502+0000 7fe2c9b03000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T12:55:36.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:36.595+0000 7fe2c9b03000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T12:55:36.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:36.690+0000 7fe2c9b03000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T12:55:37.396 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:36.938+0000 7fe2c9b03000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:55:37.397 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:37 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:37.395+0000 7fe2c9b03000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T12:55:38.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:37 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:37.894+0000 7fe2c9b03000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T12:55:38.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:37 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:37.990+0000 7fe2c9b03000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T12:55:38.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:38.293+0000 7fe2c9b03000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T12:55:38.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:38.384+0000 7fe2c9b03000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T12:55:39.147 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:38.799+0000 7fe2c9b03000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T12:55:39.147 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:38.935+0000 7fe2c9b03000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T12:55:39.148 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:39.029+0000 7fe2c9b03000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T12:55:39.148 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:39.146+0000 7fe2c9b03000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T12:55:39.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:39.236+0000 7fe2c9b03000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T12:55:40.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:39.800+0000 7fe2c9b03000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T12:55:40.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:40 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:40.172+0000 7fe2c9b03000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T12:55:41.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:40 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:12:55:40] ENGINE Bus STARTING 2024-05-06T12:55:41.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:12:55:41] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T12:55:41.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:12:55:41] ENGINE Bus STARTED 2024-05-06T12:55:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-05-06T12:55:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "initialized": true 2024-05-06T12:55:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: Active manager daemon y restarted 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: Activating manager daemon y 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: osdmap e2: 0 total, 0 up, 0 in 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: mgrmap e6: y(active, starting, since 0.100066s) 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: Manager daemon y is now available 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:41.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: [06/May/2024:12:55:40] ENGINE Bus STARTING 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:41.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:41 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:55:41.838 INFO:teuthology.orchestra.run.smithi016.stderr:mgr epoch 5 is available 2024-05-06T12:55:41.838 INFO:teuthology.orchestra.run.smithi016.stderr:Setting orchestrator backend to cephadm... 2024-05-06T12:55:42.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:42 smithi016 ceph-mon[22420]: [06/May/2024:12:55:41] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T12:55:42.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:42 smithi016 ceph-mon[22420]: [06/May/2024:12:55:41] ENGINE Bus STARTED 2024-05-06T12:55:42.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:42 smithi016 ceph-mon[22420]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-06T12:55:42.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:42 smithi016 ceph-mon[22420]: mgrmap e7: y(active, since 1.10248s) 2024-05-06T12:55:42.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:42 smithi016 ceph-mon[22420]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-06T12:55:43.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:43 smithi016 ceph-mon[22420]: mgrmap e8: y(active, since 2s) 2024-05-06T12:55:43.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:43 smithi016 ceph-mon[22420]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:43.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:43 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:43.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:43 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:55:43.683 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: value unchanged 2024-05-06T12:55:44.218 INFO:teuthology.orchestra.run.smithi016.stderr:Generating ssh key... 2024-05-06T12:55:44.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:44 smithi016 ceph-mon[22420]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:45.620 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:45 smithi016 ceph-mon[22420]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:45 smithi016 ceph-mon[22420]: Generating ssh key... 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: Generating public/private rsa key pair. 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: Your identification has been saved in /tmp/tmpix5_csnt/key. 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: Your public key has been saved in /tmp/tmpix5_csnt/key.pub. 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: The key fingerprint is: 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: SHA256:ywWqMirqr6vjQKhG43eJdRRZtPWSHVpeE+Zf6iza8Uc ceph-c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: The key's randomart image is: 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: +---[RSA 3072]----+ 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: | .+o . o =.| 2024-05-06T12:55:45.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: | .. o B = .| 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: | ... + + ..| 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: |. .. . . .o| 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: |.+ ...S . . .| 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: |= . o.o. o o E| 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: |oooo.o o o o. | 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: |=..o. o + .| 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: |X*+. . . .. | 2024-05-06T12:55:45.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: +----[SHA256]-----+ 2024-05-06T12:55:46.471 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:46 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:46.471 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:46 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:46.472 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfQYWIUALp43tgqvFzTRaxbYlGcLn9bT2spHJjK2lHWEntNhb/pbGI2/+QJZmfxP5nejQqmq32X6v1lIhTGCBH4+Cjo1pS1sUc+GvTA1lwcx74TLT6R2RtixundARY7C5Aq4tR6+gh49ziy0LZW39yIWDZVAnN2p1uj4wxUxcBXsEk1lky66ijTS9fx0DCxP1X1vh9l/oQWKadSE/+VrTz1XhncJqVr3e8ZFQhyI6e2L3QXTGdtRY2IJ7JQjIvt7NwD23oVvy+tF6DeTCPNzHe8xA47fjMoi+WCkByeRYYzHYMi9TZZorvakVSAZQHTZdOeCWWItOqCPgJYRWODaHY0vryDqwWalFqTijiNhnHwFOmm+rLfQ2WFApc/asg7I6HfKo7RUBsmOkWYsF1qNpY1Yrqz+oRuKTWfEUsNZUDNhjxICTw60rglnCoVYlRUurwUHmEEHcvHEZyjn46VxhUl6G0n1zfITx1UAILWaxVLlVFNGH/bWBK2oUkaq/rx0= ceph-c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:55:47.048 INFO:teuthology.orchestra.run.smithi016.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-06T12:55:47.048 INFO:teuthology.orchestra.run.smithi016.stderr:Adding key to root@localhost authorized_keys... 2024-05-06T12:55:47.048 INFO:teuthology.orchestra.run.smithi016.stderr:Adding host smithi016... 2024-05-06T12:55:47.656 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:47 smithi016 ceph-mon[22420]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:48.502 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: Added host 'smithi016' with addr '172.21.15.16' 2024-05-06T12:55:48.514 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:48 smithi016 ceph-mon[22420]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi016", "addr": "172.21.15.16", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:49.055 INFO:teuthology.orchestra.run.smithi016.stderr:Deploying unmanaged mon service... 2024-05-06T12:55:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:49 smithi016 ceph-mon[22420]: Deploying cephadm binary to smithi016 2024-05-06T12:55:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:49 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:49 smithi016 ceph-mon[22420]: Added host smithi016 2024-05-06T12:55:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:49 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:55:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: Scheduled mon update... 2024-05-06T12:55:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:Deploying unmanaged mgr service... 2024-05-06T12:55:50.840 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:50 smithi016 ceph-mon[22420]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:50.840 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:50 smithi016 ceph-mon[22420]: Saving service mon spec with placement count:5 2024-05-06T12:55:50.840 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:50 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:51.076 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-05-06T12:55:52.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:52 smithi016 ceph-mon[22420]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:55:52.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:52 smithi016 ceph-mon[22420]: Saving service mgr spec with placement count:2 2024-05-06T12:55:52.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:52 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:53.640 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:53 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/428923646' entity='client.admin' 2024-05-06T12:55:53.640 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:53 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:53.640 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:53 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:54.911 INFO:teuthology.orchestra.run.smithi016.stderr:Enabling the dashboard module... 2024-05-06T12:55:55.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:54 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1328430921' entity='client.admin' 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setuser ceph since I am not root 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setgroup ceph since I am not root 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:56.400+0000 7f397bac3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:56.534+0000 7f397bac3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:55:56.536 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' 2024-05-06T12:55:56.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T12:55:56.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='mgr.14120 172.21.15.16:0/2797299323' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]': finished 2024-05-06T12:55:56.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: Deploying daemon agent.smithi016 on smithi016 2024-05-06T12:55:56.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:56 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3753962610' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-06T12:55:56.911 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:56.636+0000 7f397bac3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T12:55:57.163 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:56.956+0000 7f397bac3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T12:55:57.163 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:57.041+0000 7f397bac3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T12:55:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:57 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3753962610' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-06T12:55:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:57 smithi016 ceph-mon[22420]: mgrmap e9: y(active, since 16s) 2024-05-06T12:55:57.672 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:55:57.672 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "epoch": 9, 2024-05-06T12:55:57.672 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "available": true, 2024-05-06T12:55:57.672 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "active_name": "y", 2024-05-06T12:55:57.672 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "num_standby": 0 2024-05-06T12:55:57.672 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:55:58.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:55:58 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/423678490' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-06T12:55:58.321 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:58.246+0000 7f397bac3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T12:55:58.322 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for the mgr to restart... 2024-05-06T12:55:58.322 INFO:teuthology.orchestra.run.smithi016.stderr:Waiting for mgr epoch 9... 2024-05-06T12:55:58.570 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:58.428+0000 7f397bac3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T12:55:58.570 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:58.513+0000 7f397bac3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T12:55:59.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:58.844+0000 7f397bac3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T12:55:59.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:58.938+0000 7f397bac3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T12:55:59.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:59.034+0000 7f397bac3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T12:55:59.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:59.283+0000 7f397bac3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:56:00.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:55:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:55:59.743+0000 7f397bac3000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T12:56:00.592 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:00.248+0000 7f397bac3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T12:56:00.592 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:00.347+0000 7f397bac3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T12:56:00.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:00.660+0000 7f397bac3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T12:56:00.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:00.754+0000 7f397bac3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T12:56:01.529 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:01.175+0000 7f397bac3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T12:56:01.530 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:01.314+0000 7f397bac3000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T12:56:01.530 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:01.410+0000 7f397bac3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T12:56:01.530 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:01.528+0000 7f397bac3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T12:56:01.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:01.620+0000 7f397bac3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T12:56:02.593 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:02.188+0000 7f397bac3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T12:56:02.848 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:56:02.591+0000 7f397bac3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T12:56:03.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:12:56:03] ENGINE Bus STARTING 2024-05-06T12:56:03.491 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:12:56:03] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T12:56:03.491 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:12:56:03] ENGINE Bus STARTED 2024-05-06T12:56:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: { 2024-05-06T12:56:03.656 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-05-06T12:56:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: "initialized": true 2024-05-06T12:56:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: } 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: Active manager daemon y restarted 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: Activating manager daemon y 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: osdmap e3: 0 total, 0 up, 0 in 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: mgrmap e10: y(active, starting, since 0.0526988s) 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T12:56:03.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: Manager daemon y is now available 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: [06/May/2024:12:56:03] ENGINE Bus STARTING 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: [06/May/2024:12:56:03] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: [06/May/2024:12:56:03] ENGINE Bus STARTED 2024-05-06T12:56:03.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:04.386 INFO:teuthology.orchestra.run.smithi016.stderr:mgr epoch 9 is available 2024-05-06T12:56:04.386 INFO:teuthology.orchestra.run.smithi016.stderr:Generating a dashboard self-signed certificate... 2024-05-06T12:56:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-06T12:56:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: mgrmap e11: y(active, since 1.05526s) 2024-05-06T12:56:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-06T12:56:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:56:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T12:56:05.114 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: Self-signed certificate created 2024-05-06T12:56:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:Creating initial admin user... 2024-05-06T12:56:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:06 smithi016 ceph-mon[22420]: Deploying daemon agent.smithi016 on smithi016 2024-05-06T12:56:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:06 smithi016 ceph-mon[22420]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:06 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:06 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:06 smithi016 ceph-mon[22420]: mgrmap e12: y(active, since 2s) 2024-05-06T12:56:06.621 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$xAGVC.b2492CD0Hcd2xIZeWruJTXiAmMjn2g50gu/Kb3exEx6N3UC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715000166, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-06T12:56:07.149 INFO:teuthology.orchestra.run.smithi016.stderr:Fetching dashboard port number... 2024-05-06T12:56:07.817 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:07 smithi016 ceph-mon[22420]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:07.817 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:07 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:07.818 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: 8443 2024-05-06T12:56:08.440 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: disabled 2024-05-06T12:56:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:systemctl: inactive 2024-05-06T12:56:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:firewalld.service is not enabled 2024-05-06T12:56:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-06T12:56:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:Ceph Dashboard is now available at: 2024-05-06T12:56:08.450 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:08.450 INFO:teuthology.orchestra.run.smithi016.stderr: URL: https://smithi016:8443/ 2024-05-06T12:56:08.450 INFO:teuthology.orchestra.run.smithi016.stderr: User: admin 2024-05-06T12:56:08.450 INFO:teuthology.orchestra.run.smithi016.stderr: Password: ivsnjoo5ft 2024-05-06T12:56:08.450 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:Enabling autotune for osd_memory_target 2024-05-06T12:56:08.686 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:08 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/666912552' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-06T12:56:09.636 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:09 smithi016 ceph-mon[22420]: mgrmap e13: y(active, since 6s) 2024-05-06T12:56:10.363 INFO:teuthology.orchestra.run.smithi016.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-05-06T12:56:10.946 INFO:teuthology.orchestra.run.smithi016.stderr:You can access the Ceph CLI with: 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr:Please consider enabling telemetry to help improve Ceph: 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr: ceph telemetry on 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:10.947 INFO:teuthology.orchestra.run.smithi016.stderr:For more information see: 2024-05-06T12:56:10.948 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:10.948 INFO:teuthology.orchestra.run.smithi016.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-05-06T12:56:10.948 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T12:56:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:Bootstrap complete. 2024-05-06T12:56:11.143 INFO:tasks.cephadm:Fetching config... 2024-05-06T12:56:11.144 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:11.144 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-06T12:56:11.160 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-06T12:56:11.160 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:11.160 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-06T12:56:11.218 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-06T12:56:11.218 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:11.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-06T12:56:11.332 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-06T12:56:11.332 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:11.332 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-06T12:56:11.388 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-06T12:56:11.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfQYWIUALp43tgqvFzTRaxbYlGcLn9bT2spHJjK2lHWEntNhb/pbGI2/+QJZmfxP5nejQqmq32X6v1lIhTGCBH4+Cjo1pS1sUc+GvTA1lwcx74TLT6R2RtixundARY7C5Aq4tR6+gh49ziy0LZW39yIWDZVAnN2p1uj4wxUxcBXsEk1lky66ijTS9fx0DCxP1X1vh9l/oQWKadSE/+VrTz1XhncJqVr3e8ZFQhyI6e2L3QXTGdtRY2IJ7JQjIvt7NwD23oVvy+tF6DeTCPNzHe8xA47fjMoi+WCkByeRYYzHYMi9TZZorvakVSAZQHTZdOeCWWItOqCPgJYRWODaHY0vryDqwWalFqTijiNhnHwFOmm+rLfQ2WFApc/asg7I6HfKo7RUBsmOkWYsF1qNpY1Yrqz+oRuKTWfEUsNZUDNhjxICTw60rglnCoVYlRUurwUHmEEHcvHEZyjn46VxhUl6G0n1zfITx1UAILWaxVLlVFNGH/bWBK2oUkaq/rx0= ceph-c6d11770-0ba7-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-06T12:56:11.535 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:11 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3512590722' entity='client.admin' 2024-05-06T12:56:11.693 INFO:teuthology.orchestra.run.smithi016.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfQYWIUALp43tgqvFzTRaxbYlGcLn9bT2spHJjK2lHWEntNhb/pbGI2/+QJZmfxP5nejQqmq32X6v1lIhTGCBH4+Cjo1pS1sUc+GvTA1lwcx74TLT6R2RtixundARY7C5Aq4tR6+gh49ziy0LZW39yIWDZVAnN2p1uj4wxUxcBXsEk1lky66ijTS9fx0DCxP1X1vh9l/oQWKadSE/+VrTz1XhncJqVr3e8ZFQhyI6e2L3QXTGdtRY2IJ7JQjIvt7NwD23oVvy+tF6DeTCPNzHe8xA47fjMoi+WCkByeRYYzHYMi9TZZorvakVSAZQHTZdOeCWWItOqCPgJYRWODaHY0vryDqwWalFqTijiNhnHwFOmm+rLfQ2WFApc/asg7I6HfKo7RUBsmOkWYsF1qNpY1Yrqz+oRuKTWfEUsNZUDNhjxICTw60rglnCoVYlRUurwUHmEEHcvHEZyjn46VxhUl6G0n1zfITx1UAILWaxVLlVFNGH/bWBK2oUkaq/rx0= ceph-c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:56:11.704 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfQYWIUALp43tgqvFzTRaxbYlGcLn9bT2spHJjK2lHWEntNhb/pbGI2/+QJZmfxP5nejQqmq32X6v1lIhTGCBH4+Cjo1pS1sUc+GvTA1lwcx74TLT6R2RtixundARY7C5Aq4tR6+gh49ziy0LZW39yIWDZVAnN2p1uj4wxUxcBXsEk1lky66ijTS9fx0DCxP1X1vh9l/oQWKadSE/+VrTz1XhncJqVr3e8ZFQhyI6e2L3QXTGdtRY2IJ7JQjIvt7NwD23oVvy+tF6DeTCPNzHe8xA47fjMoi+WCkByeRYYzHYMi9TZZorvakVSAZQHTZdOeCWWItOqCPgJYRWODaHY0vryDqwWalFqTijiNhnHwFOmm+rLfQ2WFApc/asg7I6HfKo7RUBsmOkWYsF1qNpY1Yrqz+oRuKTWfEUsNZUDNhjxICTw60rglnCoVYlRUurwUHmEEHcvHEZyjn46VxhUl6G0n1zfITx1UAILWaxVLlVFNGH/bWBK2oUkaq/rx0= ceph-c6d11770-0ba7-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-06T12:56:11.744 INFO:teuthology.orchestra.run.smithi186.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfQYWIUALp43tgqvFzTRaxbYlGcLn9bT2spHJjK2lHWEntNhb/pbGI2/+QJZmfxP5nejQqmq32X6v1lIhTGCBH4+Cjo1pS1sUc+GvTA1lwcx74TLT6R2RtixundARY7C5Aq4tR6+gh49ziy0LZW39yIWDZVAnN2p1uj4wxUxcBXsEk1lky66ijTS9fx0DCxP1X1vh9l/oQWKadSE/+VrTz1XhncJqVr3e8ZFQhyI6e2L3QXTGdtRY2IJ7JQjIvt7NwD23oVvy+tF6DeTCPNzHe8xA47fjMoi+WCkByeRYYzHYMi9TZZorvakVSAZQHTZdOeCWWItOqCPgJYRWODaHY0vryDqwWalFqTijiNhnHwFOmm+rLfQ2WFApc/asg7I6HfKo7RUBsmOkWYsF1qNpY1Yrqz+oRuKTWfEUsNZUDNhjxICTw60rglnCoVYlRUurwUHmEEHcvHEZyjn46VxhUl6G0n1zfITx1UAILWaxVLlVFNGH/bWBK2oUkaq/rx0= ceph-c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:56:11.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-06T12:56:12.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:56:12] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:13.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:13.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:13.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:13.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:13.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:13.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:13.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:15.907 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:56:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:16.179 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-06T12:56:16.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-06T12:56:16.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:16 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1923357339' entity='client.admin' 2024-05-06T12:56:16.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:16.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:16.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:16.756 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:17.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:56:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:18.639 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:18 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:18.639 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:18 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:18.639 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:18 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:18.639 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:18 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:18.639 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:18 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:18.639 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:18 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:19.179 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi186 2024-05-06T12:56:19.179 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T12:56:19.179 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.conf 2024-05-06T12:56:19.198 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T12:56:19.198 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T12:56:19.256 INFO:tasks.cephadm:Adding host smithi186 to orchestrator... 2024-05-06T12:56:19.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch host add smithi186 2024-05-06T12:56:19.842 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:19 smithi016 ceph-mon[22420]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:19.842 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:19 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T12:56:19.842 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:19 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T12:56:19.842 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:19.842 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:21.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:21 smithi016 ceph-mon[22420]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:21.903 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi186' with addr '172.21.15.186' 2024-05-06T12:56:22.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-06T12:56:23.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: Deploying cephadm binary to smithi186 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: Added host smithi186 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T12:56:23.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]': finished 2024-05-06T12:56:23.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:24.337 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T12:56:24.337 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}] 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: Deploying daemon agent.smithi186 on smithi186 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:24.615 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:24.616 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:24.616 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:24.939 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-06T12:56:24.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-06T12:56:25.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:25.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:25 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T12:56:25.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:25.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:26.283 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:26 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:26 smithi016 ceph-mon[22420]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T12:56:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:26 smithi016 ceph-mon[22420]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:26 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:26 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:27.291 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-05-06T12:56:27.544 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:27 smithi016 ceph-mon[22420]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:27.544 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:27 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2850516802' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-06T12:56:27.816 INFO:tasks.cephadm:Adding mon.a on smithi016 2024-05-06T12:56:27.816 INFO:tasks.cephadm:Adding mon.c on smithi016 2024-05-06T12:56:27.816 INFO:tasks.cephadm:Adding mon.b on smithi186 2024-05-06T12:56:27.817 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi016:172.21.15.16=a;smithi016:[v2:172.21.15.16:3301,v1:172.21.15.16:6790]=c;smithi186:172.21.15.186=b' 2024-05-06T12:56:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:28 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2850516802' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-06T12:56:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:28 smithi016 ceph-mon[22420]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:28 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:29.676 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mon update... 2024-05-06T12:56:30.223 DEBUG:teuthology.orchestra.run.smithi016:mon.c> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c.service 2024-05-06T12:56:30.226 DEBUG:teuthology.orchestra.run.smithi186:mon.b> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.b.service 2024-05-06T12:56:30.229 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-06T12:56:30.229 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T12:56:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:31.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:31 smithi016 ceph-mon[22420]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi016:172.21.15.16=a;smithi016:[v2:172.21.15.16:3301,v1:172.21.15.16:6790]=c;smithi186:172.21.15.186=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:31.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:31 smithi016 ceph-mon[22420]: Saving service mon spec with placement smithi016:172.21.15.16=a;smithi016:[v2:172.21.15.16:3301,v1:172.21.15.16:6790]=c;smithi186:172.21.15.186=b;count:3 2024-05-06T12:56:31.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:31 smithi016 ceph-mon[22420]: Deploying daemon mon.c on smithi016 2024-05-06T12:56:32.065 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:56:32.065 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":1,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","modified":"2024-05-06T12:55:06.791929Z","created":"2024-05-06T12:55:06.791929Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-06T12:56:32.067 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 1 2024-05-06T12:56:32.540 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:32 smithi016 ceph-mon[22420]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:32.540 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:32 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/2793817562' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T12:56:33.441 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:33 smithi016 ceph-mon[22420]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:33.626 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-06T12:56:33.626 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:56:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: mon.a calling monitor election 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: mon.c calling monitor election 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: monmap e2: 2 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],c=[v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0]} 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: fsmap 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: mgrmap e13: y(active, since 36s) 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: overall HEALTH_OK 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:39.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:39.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:38 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:39.853 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:56:39.853 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","modified":"2024-05-06T12:56:33.852137Z","created":"2024-05-06T12:55:06.791929Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3301","nonce":0},{"type":"v1","addr":"172.21.15.16:6790","nonce":0}]},"addr":"172.21.15.16:6790/0","public_addr":"172.21.15.16:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-06T12:56:39.855 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2024-05-06T12:56:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[22420]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[22420]: Deploying daemon mon.b on smithi186 2024-05-06T12:56:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:40.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/3653715325' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T12:56:40.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[27395]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:40.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[27395]: Deploying daemon mon.b on smithi186 2024-05-06T12:56:40.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:40.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:40 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/3653715325' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T12:56:42.247 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-06T12:56:42.247 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T12:56:42.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:42 smithi016 ceph-mon[22420]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:42.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:42 smithi016 ceph-mon[27395]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:43.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:43 smithi016 ceph-mon[22420]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:43 smithi016 ceph-mon[27395]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:44.203 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:56:44.203 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","modified":"2024-05-06T12:56:33.852137Z","created":"2024-05-06T12:55:06.791929Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3301","nonce":0},{"type":"v1","addr":"172.21.15.16:6790","nonce":0}]},"addr":"172.21.15.16:6790/0","public_addr":"172.21.15.16:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-06T12:56:44.204 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2024-05-06T12:56:45.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:44 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/4062007299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T12:56:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:44 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/4062007299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-06T12:56:45.909 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-06T12:56:45.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-06T12:56:50.561 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:50 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:50.561 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:50 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:50.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:50.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:56:50.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: mon.a calling monitor election 2024-05-06T12:56:50.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: mon.c calling monitor election 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: monmap e3: 3 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0]} 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: fsmap 2024-05-06T12:56:50.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: mgrmap e13: y(active, since 47s) 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:50.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: mon.a calling monitor election 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: mon.c calling monitor election 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:50.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: monmap e3: 3 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0]} 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: fsmap 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: mgrmap e13: y(active, since 47s) 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:50.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:51.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:51] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: Reconfiguring mon.a (unknown last config time)... 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T12:56:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: Reconfiguring daemon mon.a on smithi016 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: Reconfiguring mon.a (unknown last config time)... 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: Reconfiguring daemon mon.a on smithi016 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-05-06T12:56:52.041 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":3,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","modified":"2024-05-06T12:56:45.274116Z","created":"2024-05-06T12:55:06.791929Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3301","nonce":0},{"type":"v1","addr":"172.21.15.16:6790","nonce":0}]},"addr":"172.21.15.16:6790/0","public_addr":"172.21.15.16:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-06T12:56:52.042 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 3 2024-05-06T12:56:52.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:52.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:56:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:52.688 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-06T12:56:52.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-06T12:56:52.968 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: mon.b calling monitor election 2024-05-06T12:56:52.968 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: Reconfiguring mon.c (monmap changed)... 2024-05-06T12:56:52.968 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: Reconfiguring daemon mon.c on smithi016 2024-05-06T12:56:52.968 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: mon.b calling monitor election 2024-05-06T12:56:52.968 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: mon.c calling monitor election 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: mon.a calling monitor election 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: monmap e3: 3 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0]} 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: fsmap 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: mgrmap e13: y(active, since 49s) 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: overall HEALTH_OK 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:52.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: mon.b calling monitor election 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: Reconfiguring mon.c (monmap changed)... 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: Reconfiguring daemon mon.c on smithi016 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: mon.b calling monitor election 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: mon.c calling monitor election 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: mon.a calling monitor election 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: monmap e3: 3 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0]} 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: fsmap 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: mgrmap e13: y(active, since 49s) 2024-05-06T12:56:53.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: overall HEALTH_OK 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: mon.b calling monitor election 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: Reconfiguring mon.c (monmap changed)... 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: Reconfiguring daemon mon.c on smithi016 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: mon.b calling monitor election 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: mon.c calling monitor election 2024-05-06T12:56:53.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: mon.a calling monitor election 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: monmap e3: 3 mons at {a=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0]} 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: fsmap 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: osdmap e4: 0 total, 0 up, 0 in 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: mgrmap e13: y(active, since 49s) 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: overall HEALTH_OK 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.320 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:56:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:53.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[27395]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:53.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:53.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[22420]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:53.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:53.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:53.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:53 smithi186 ceph-mon[23420]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:56:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: Reconfiguring mon.b (monmap changed)... 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: Reconfiguring daemon mon.b on smithi186 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[22420]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: Reconfiguring mon.b (monmap changed)... 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: Reconfiguring daemon mon.b on smithi186 2024-05-06T12:56:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:55 smithi016 ceph-mon[27395]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: Reconfiguring mon.b (monmap changed)... 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: Reconfiguring daemon mon.b on smithi186 2024-05-06T12:56:55.803 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:55 smithi186 ceph-mon[23420]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:55.899 INFO:teuthology.orchestra.run.smithi016.stdout:# minimal ceph.conf for c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:56:55.900 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-05-06T12:56:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T12:56:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: mon_host = [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-05-06T12:56:56.503 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-06T12:56:56.503 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:56.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.conf 2024-05-06T12:56:56.531 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:56.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T12:56:56.596 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T12:56:56.596 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.conf 2024-05-06T12:56:56.627 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T12:56:56.627 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-06T12:56:56.694 INFO:tasks.cephadm:Adding mgr.y on smithi016 2024-05-06T12:56:56.695 INFO:tasks.cephadm:Adding mgr.x on smithi186 2024-05-06T12:56:56.695 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch apply mgr '2;smithi016=y;smithi186=x' 2024-05-06T12:56:57.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:56 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2120253753' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2120253753' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:57.041 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:57.042 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:57.042 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:56 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2120253753' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:57.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:56:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:56:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:56:58.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:58 smithi016 ceph-mon[22420]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:58.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:58 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:58.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:58 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:58.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:58 smithi016 ceph-mon[27395]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:58.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:58 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:58.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:58 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:58 smithi186 ceph-mon[23420]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:58 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:58 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:58.530 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mgr update... 2024-05-06T12:56:59.093 DEBUG:teuthology.orchestra.run.smithi186:mgr.x> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service 2024-05-06T12:56:59.095 INFO:tasks.cephadm:Deploying OSDs... 2024-05-06T12:56:59.095 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T12:56:59.095 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T12:56:59.115 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T12:56:59.115 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-06 12:56:56.330455520 +0000 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-06 12:54:10.031962690 +0000 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-06 12:54:10.031962690 +0000 2024-05-06T12:56:59.174 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-06 12:54:10.031962690 +0000 2024-05-06T12:56:59.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T12:56:59.243 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-06T12:56:59.243 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-06T12:56:59.243 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000133003 s, 3.8 MB/s 2024-05-06T12:56:59.245 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T12:56:59.304 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-05-06T12:56:59.360 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-06 12:56:56.330455520 +0000 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-06 12:54:10.372957028 +0000 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-06 12:54:10.372957028 +0000 2024-05-06T12:56:59.361 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-06 12:54:10.372957028 +0000 2024-05-06T12:56:59.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T12:56:59.425 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-06T12:56:59.426 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-06T12:56:59.426 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000118144 s, 4.3 MB/s 2024-05-06T12:56:59.427 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T12:56:59.484 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-05-06T12:56:59.541 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T12:56:59.541 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:56:59.541 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-06T12:56:59.542 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:56:59.542 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:56:59.542 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-06 12:56:56.330455520 +0000 2024-05-06T12:56:59.542 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-06 12:54:10.705951498 +0000 2024-05-06T12:56:59.542 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-06 12:54:10.705951498 +0000 2024-05-06T12:56:59.542 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-06 12:54:10.705951498 +0000 2024-05-06T12:56:59.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T12:56:59.610 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-06T12:56:59.610 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-06T12:56:59.610 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.00010455 s, 4.9 MB/s 2024-05-06T12:56:59.610 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T12:56:59.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='client.34109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi016=y;smithi186=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:59.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: Saving service mgr spec with placement smithi016=y;smithi186=x;count:2 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: Deploying daemon mgr.x on smithi186 2024-05-06T12:56:59.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:56:59 smithi186 ceph-mon[23420]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:59.668 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-05-06T12:56:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T12:56:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:56:59.724 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-06T12:56:59.725 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:56:59.725 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:56:59.725 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-06 12:56:56.330455520 +0000 2024-05-06T12:56:59.725 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-06 12:54:11.037945985 +0000 2024-05-06T12:56:59.725 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-06 12:54:11.037945985 +0000 2024-05-06T12:56:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-06 12:54:11.037945985 +0000 2024-05-06T12:56:59.725 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T12:56:59.786 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='client.34109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi016=y;smithi186=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:59.786 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: Saving service mgr spec with placement smithi016=y;smithi186=x;count:2 2024-05-06T12:56:59.786 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:59.786 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: Deploying daemon mgr.x on smithi186 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[22420]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='client.34109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi016=y;smithi186=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: Saving service mgr spec with placement smithi016=y;smithi186=x;count:2 2024-05-06T12:56:59.787 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: Deploying daemon mgr.x on smithi186 2024-05-06T12:56:59.788 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:56:59 smithi016 ceph-mon[27395]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:56:59.788 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-06T12:56:59.789 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-06T12:56:59.789 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000110357 s, 4.6 MB/s 2024-05-06T12:56:59.790 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T12:56:59.847 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T12:56:59.847 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T12:56:59.863 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T12:56:59.863 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-05-06 12:56:52.526619456 +0000 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-05-06 12:54:05.172045305 +0000 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-05-06 12:54:05.172045305 +0000 2024-05-06T12:56:59.919 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-05-06 12:54:05.172045305 +0000 2024-05-06T12:56:59.920 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T12:56:59.983 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-05-06T12:56:59.983 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-05-06T12:56:59.983 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000188668 s, 2.7 MB/s 2024-05-06T12:56:59.984 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T12:57:00.039 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-05-06T12:57:00.094 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T12:57:00.094 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:57:00.094 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-06T12:57:00.094 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:57:00.095 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:57:00.095 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-05-06 12:56:52.526619456 +0000 2024-05-06T12:57:00.095 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-05-06 12:54:05.514038418 +0000 2024-05-06T12:57:00.095 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-05-06 12:54:05.514038418 +0000 2024-05-06T12:57:00.095 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-05-06 12:54:05.514038418 +0000 2024-05-06T12:57:00.095 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T12:57:00.158 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-05-06T12:57:00.158 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-05-06T12:57:00.158 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000178793 s, 2.9 MB/s 2024-05-06T12:57:00.159 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T12:57:00.215 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-05-06T12:57:00.270 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T12:57:00.270 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:57:00.270 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-06T12:57:00.270 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:57:00.271 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:57:00.271 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-05-06 12:56:52.526619456 +0000 2024-05-06T12:57:00.271 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-05-06 12:54:05.849031672 +0000 2024-05-06T12:57:00.271 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-05-06 12:54:05.849031672 +0000 2024-05-06T12:57:00.271 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-05-06 12:54:05.849031672 +0000 2024-05-06T12:57:00.271 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T12:57:00.439 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-05-06T12:57:00.439 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-05-06T12:57:00.439 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000206236 s, 2.5 MB/s 2024-05-06T12:57:00.439 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T12:57:00.454 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-05-06T12:57:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T12:57:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T12:57:00.515 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-06T12:57:00.515 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T12:57:00.516 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-05-06T12:57:00.516 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-05-06 12:57:00.396472399 +0000 2024-05-06T12:57:00.516 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-05-06 12:54:06.189024826 +0000 2024-05-06T12:57:00.516 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-05-06 12:54:06.189024826 +0000 2024-05-06T12:57:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-05-06 12:54:06.189024826 +0000 2024-05-06T12:57:00.516 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T12:57:00.616 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-05-06T12:57:00.616 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-05-06T12:57:00.616 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000181409 s, 2.8 MB/s 2024-05-06T12:57:00.617 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T12:57:00.632 INFO:tasks.cephadm:Deploying osd.0 on smithi016 with /dev/vg_nvme/lv_4... 2024-05-06T12:57:00.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-06T12:57:00.855 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:00 smithi186 systemd[1]: Starting Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T12:57:01.174 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:00 smithi186 podman[24875]: 2024-05-06 12:57:00.854684006 +0000 UTC m=+0.105237305 container create 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, architecture=x86_64, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., distribution-scope=public, ceph=True, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8) 2024-05-06T12:57:01.175 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:00 smithi186 podman[24875]: 2024-05-06 12:57:00.767959947 +0000 UTC m=+0.018513200 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-06T12:57:01.175 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 podman[24875]: 2024-05-06 12:57:01.056985933 +0000 UTC m=+0.307539186 container init 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, release=754, GIT_CLEAN=True, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git) 2024-05-06T12:57:01.175 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 podman[24875]: 2024-05-06 12:57:01.059648794 +0000 UTC m=+0.310202050 container start 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., io.buildah.version=1.19.8, vcs-type=git, name=centos-stream, GIT_BRANCH=HEAD, release=754, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, maintainer=Guillaume Abrioux , architecture=x86_64, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-06T12:57:01.175 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 ceph-mgr[24894]: -- 172.21.15.186:0/639807833 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55894cf2c340 con 0x55894cf05000 2024-05-06T12:57:01.175 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 bash[24875]: 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 2024-05-06T12:57:01.431 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 systemd[1]: Started Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T12:57:01.431 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:01.201+0000 7f8fba203000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T12:57:01.431 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:01.335+0000 7f8fba203000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:57:01.432 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:01.430+0000 7f8fba203000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T12:57:02.006 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:01.731+0000 7f8fba203000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T12:57:02.006 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:01.824+0000 7f8fba203000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:57:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: Reconfiguring mgr.y (unknown last config time)... 2024-05-06T12:57:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T12:57:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T12:57:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:02 smithi186 ceph-mon[23420]: Reconfiguring daemon mgr.y on smithi016 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: Reconfiguring mgr.y (unknown last config time)... 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T12:57:02.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[27395]: Reconfiguring daemon mgr.y on smithi016 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: Reconfiguring mgr.y (unknown last config time)... 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T12:57:02.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:02.566 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:02 smithi016 ceph-mon[22420]: Reconfiguring daemon mgr.y on smithi016 2024-05-06T12:57:03.055 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:03.003+0000 7f8fba203000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:03.517 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:03.176+0000 7f8fba203000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T12:57:03.517 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:03.260+0000 7f8fba203000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T12:57:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-06T12:57:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-06T12:57:03.615 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2024-05-06T12:57:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2024-05-06T12:57:03.615 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00890162 s, 1.2 GB/s 2024-05-06T12:57:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2024-05-06T12:57:03.846 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:03.597+0000 7f8fba203000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T12:57:03.846 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:03.692+0000 7f8fba203000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T12:57:03.846 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:03.792+0000 7f8fba203000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T12:57:04.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_4 2024-05-06T12:57:04.248 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:04.043+0000 7f8fba203000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T12:57:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:04 smithi186 ceph-mon[23420]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:57:04.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:04.494+0000 7f8fba203000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T12:57:04.517 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:04 smithi016 ceph-mon[22420]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:04.518 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:57:04.518 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:04 smithi016 ceph-mon[27395]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:04.518 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T12:57:04.831 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:04 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:57:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:05.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:04 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:57:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:05.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:04.991+0000 7f8fba203000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T12:57:05.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:05.083+0000 7f8fba203000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T12:57:05.737 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:05.372+0000 7f8fba203000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T12:57:05.737 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:05.459+0000 7f8fba203000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:05.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:05.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:05.857+0000 7f8fba203000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:05.986+0000 7f8fba203000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:06.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:06.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:06.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:06.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:06.076+0000 7f8fba203000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T12:57:06.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:06.188+0000 7f8fba203000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T12:57:06.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:06.275+0000 7f8fba203000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[22420]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[27395]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:06.783 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:06 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:06 smithi186 ceph-mon[23420]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:06 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:06 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:06 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:07.016 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:06.810+0000 7f8fba203000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T12:57:07.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 12:57:07 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T12:57:07.182+0000 7f8fba203000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T12:57:07.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[27395]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:07.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[27395]: Standby manager daemon x started 2024-05-06T12:57:07.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T12:57:07.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T12:57:07.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T12:57:07.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T12:57:07.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[22420]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:07.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[22420]: Standby manager daemon x started 2024-05-06T12:57:07.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T12:57:07.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T12:57:07.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T12:57:07.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:07 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T12:57:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:07 smithi186 ceph-mon[23420]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:07 smithi186 ceph-mon[23420]: Standby manager daemon x started 2024-05-06T12:57:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:07 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T12:57:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:07 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T12:57:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:07 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T12:57:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:07 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/4239136652' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: mgrmap e14: y(active, since 65s), standbys: x 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1314486048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]: dispatch 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]: dispatch 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]': finished 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: osdmap e5: 1 total, 0 up, 1 in 2024-05-06T12:57:09.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:08 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:09.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: mgrmap e14: y(active, since 65s), standbys: x 2024-05-06T12:57:09.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T12:57:09.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1314486048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]: dispatch 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]: dispatch 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]': finished 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: osdmap e5: 1 total, 0 up, 1 in 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: mgrmap e14: y(active, since 65s), standbys: x 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1314486048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]: dispatch 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]: dispatch 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b65bb4b5-306f-4119-b718-ebf00c295292"}]': finished 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: osdmap e5: 1 total, 0 up, 1 in 2024-05-06T12:57:09.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:08 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:10.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:09 smithi186 ceph-mon[23420]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:10.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:09 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1989934542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:10.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:09 smithi016 ceph-mon[22420]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:10.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:09 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1989934542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:09 smithi016 ceph-mon[27395]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:09 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1989934542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:11.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:11 smithi016 ceph-mon[22420]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:11.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:11 smithi016 ceph-mon[27395]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:11 smithi186 ceph-mon[23420]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:13 smithi186 ceph-mon[23420]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:14.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:13 smithi016 ceph-mon[22420]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:14.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:13 smithi016 ceph-mon[27395]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:16.496 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:57:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:16.496 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[22420]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:16.496 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T12:57:16.496 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:16.496 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:16.497 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:16.497 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[27395]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:16.497 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T12:57:16.497 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:16.497 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:16.497 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:16 smithi186 ceph-mon[23420]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T12:57:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:17.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:17 smithi016 ceph-mon[22420]: Deploying daemon osd.0 on smithi016 2024-05-06T12:57:17.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:17 smithi016 ceph-mon[22420]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:17.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:17 smithi016 ceph-mon[27395]: Deploying daemon osd.0 on smithi016 2024-05-06T12:57:17.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:17 smithi016 ceph-mon[27395]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:17.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:17 smithi186 ceph-mon[23420]: Deploying daemon osd.0 on smithi016 2024-05-06T12:57:17.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:17 smithi186 ceph-mon[23420]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:20.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:20 smithi016 ceph-mon[22420]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:20 smithi016 ceph-mon[27395]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:20 smithi186 ceph-mon[23420]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:21.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:21 smithi016 ceph-mon[22420]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:21 smithi016 ceph-mon[27395]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:21 smithi186 ceph-mon[23420]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:22.967 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:22 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:22.967 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:22 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:22.967 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:22 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:22.967 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:22 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:22.967 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:22 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:23.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:23.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:23.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:23.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:23.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:22 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:23.477 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:57:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:24 smithi186 ceph-mon[23420]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:24.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:24 smithi016 ceph-mon[22420]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:24.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:24.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:24.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:24 smithi016 ceph-mon[27395]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:24.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:24.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:24.582 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 0 on host 'smithi016' 2024-05-06T12:57:25.236 DEBUG:teuthology.orchestra.run.smithi016:osd.0> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0.service 2024-05-06T12:57:25.238 INFO:tasks.cephadm:Deploying osd.1 on smithi016 with /dev/vg_nvme/lv_3... 2024-05-06T12:57:25.238 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-06T12:57:25.851 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi016 to 15045M 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T12:57:25.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[27395]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi016 to 15045M 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T12:57:25.853 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:25 smithi016 ceph-mon[22420]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi016 to 15045M 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T12:57:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:25 smithi186 ceph-mon[23420]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T12:57:26.865 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[22420]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T12:57:26.865 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[22420]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T12:57:26.865 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:26.865 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[22420]: from='osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:26.865 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[22420]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:26.865 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[27395]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T12:57:26.866 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[27395]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T12:57:26.866 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:26.866 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[27395]: from='osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:26.866 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:26 smithi016 ceph-mon[27395]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:26.866 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:57:26 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[30681]: 2024-05-06T12:57:26.648+0000 7f4af49dc700 -1 osd.0 0 waiting for initial osdmap 2024-05-06T12:57:26.866 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:57:26 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[30681]: 2024-05-06T12:57:26.651+0000 7f4af0b76700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:57:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:26 smithi186 ceph-mon[23420]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T12:57:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:26 smithi186 ceph-mon[23420]: osdmap e6: 1 total, 0 up, 1 in 2024-05-06T12:57:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:26 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:26 smithi186 ceph-mon[23420]: from='osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:26 smithi186 ceph-mon[23420]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:27.176 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-06T12:57:27.176 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-06T12:57:27.177 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2024-05-06T12:57:27.177 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2024-05-06T12:57:27.177 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00958221 s, 1.1 GB/s 2024-05-06T12:57:27.177 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2024-05-06T12:57:27.794 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[22420]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[22420]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[22420]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[27395]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[27395]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:27.795 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:27 smithi016 ceph-mon[27395]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:27.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_3 2024-05-06T12:57:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:27 smithi186 ceph-mon[23420]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:57:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:27 smithi186 ceph-mon[23420]: osdmap e7: 1 total, 0 up, 1 in 2024-05-06T12:57:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:27 smithi186 ceph-mon[23420]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-06T12:57:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[22420]: osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006] boot 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[22420]: osdmap e8: 1 total, 1 up, 1 in 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[27395]: osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006] boot 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[27395]: osdmap e8: 1 total, 1 up, 1 in 2024-05-06T12:57:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:28 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:28 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:57:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:28 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:57:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:28 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:28 smithi186 ceph-mon[23420]: osd.0 [v2:172.21.15.16:6802/4101754006,v1:172.21.15.16:6803/4101754006] boot 2024-05-06T12:57:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:28 smithi186 ceph-mon[23420]: osdmap e8: 1 total, 1 up, 1 in 2024-05-06T12:57:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:28 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T12:57:29.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:29 smithi016 ceph-mon[22420]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T12:57:29.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:29 smithi016 ceph-mon[22420]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:29.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:29 smithi016 ceph-mon[27395]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T12:57:29.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:29 smithi016 ceph-mon[27395]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:29 smithi186 ceph-mon[23420]: osdmap e9: 1 total, 1 up, 1 in 2024-05-06T12:57:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:29 smithi186 ceph-mon[23420]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[22420]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:30.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[27395]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:30 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:30 smithi186 ceph-mon[23420]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:30 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:30 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:30 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:31.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:31 smithi016 ceph-mon[22420]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:32.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:31 smithi186 ceph-mon[23420]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:32.040 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:31 smithi016 ceph-mon[27395]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:32.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:32 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:57:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:33.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:33.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi016 2024-05-06T12:57:33.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:33.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1593896247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]: dispatch 2024-05-06T12:57:33.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]: dispatch 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]': finished 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: osdmap e10: 2 total, 1 up, 2 in 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi016 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1593896247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]: dispatch 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]: dispatch 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]': finished 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: osdmap e10: 2 total, 1 up, 2 in 2024-05-06T12:57:33.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:33.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi016 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1593896247' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]: dispatch 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]: dispatch 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b20ce14b-8156-4f9a-8dc4-9d4df269ea73"}]': finished 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: osdmap e10: 2 total, 1 up, 2 in 2024-05-06T12:57:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:34 smithi016 ceph-mon[22420]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:34 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3927340928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:34 smithi016 ceph-mon[27395]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:34 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3927340928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:34 smithi186 ceph-mon[23420]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:34 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3927340928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:35.661 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:35 smithi016 ceph-mon[22420]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:35.662 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:35 smithi016 ceph-mon[27395]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:35.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:35 smithi186 ceph-mon[23420]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:37.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:37 smithi016 ceph-mon[22420]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:37.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:37 smithi016 ceph-mon[27395]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:38.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:37 smithi186 ceph-mon[23420]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:40.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:40 smithi016 ceph-mon[22420]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:40.512 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:40 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T12:57:40.512 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:40 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:40.512 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:40 smithi016 ceph-mon[27395]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:40.512 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:40 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T12:57:40.512 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:40 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:40 smithi186 ceph-mon[23420]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:40 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T12:57:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:40 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:41 smithi016 ceph-mon[22420]: Deploying daemon osd.1 on smithi016 2024-05-06T12:57:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:41 smithi016 ceph-mon[22420]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:41.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:41 smithi016 ceph-mon[27395]: Deploying daemon osd.1 on smithi016 2024-05-06T12:57:41.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:41 smithi016 ceph-mon[27395]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:41.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:41 smithi186 ceph-mon[23420]: Deploying daemon osd.1 on smithi016 2024-05-06T12:57:41.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:41 smithi186 ceph-mon[23420]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:43.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:57:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:44.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:43 smithi186 ceph-mon[23420]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:44.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:43 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:44.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:43 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:44.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:43 smithi016 ceph-mon[22420]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:44.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:43 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:44.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:43 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:44.162 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:43 smithi016 ceph-mon[27395]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:44.162 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:43 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:44.162 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:43 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:45 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:45 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:45 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:45 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:45.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:45 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:45 smithi186 ceph-mon[23420]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:45.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:45.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:45.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:45.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.870 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[22420]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:45.871 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.871 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:45.871 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:45.871 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:45.871 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:45.871 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:45 smithi016 ceph-mon[27395]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:47.148 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 1 on host 'smithi016' 2024-05-06T12:57:47.819 DEBUG:teuthology.orchestra.run.smithi016:osd.1> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1.service 2024-05-06T12:57:47.822 INFO:tasks.cephadm:Deploying osd.2 on smithi016 with /dev/vg_nvme/lv_2... 2024-05-06T12:57:47.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-06T12:57:48.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:48.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:48.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:48.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi016 to 7522M 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[27395]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:48.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi016 to 7522M 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T12:57:48.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:48 smithi016 ceph-mon[22420]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi016 to 7522M 2024-05-06T12:57:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:48.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T12:57:48.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:48 smithi186 ceph-mon[23420]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[22420]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[22420]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[22420]: from='osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[22420]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[27395]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T12:57:49.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[27395]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T12:57:49.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:49.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[27395]: from='osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:49.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:49 smithi016 ceph-mon[27395]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:49.387 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:57:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[33571]: 2024-05-06T12:57:49.189+0000 7f5345d17700 -1 osd.1 0 waiting for initial osdmap 2024-05-06T12:57:49.387 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:57:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[33571]: 2024-05-06T12:57:49.192+0000 7f533f6ac700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:57:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:49 smithi186 ceph-mon[23420]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T12:57:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:49 smithi186 ceph-mon[23420]: osdmap e11: 2 total, 1 up, 2 in 2024-05-06T12:57:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:49 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:49 smithi186 ceph-mon[23420]: from='osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:49 smithi186 ceph-mon[23420]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:57:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-06T12:57:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-06T12:57:49.864 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2024-05-06T12:57:49.865 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2024-05-06T12:57:49.865 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0104135 s, 1.0 GB/s 2024-05-06T12:57:49.865 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2024-05-06T12:57:50.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_2 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[22420]: pgmap v54: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[22420]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[22420]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[27395]: pgmap v54: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[27395]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:57:50.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[27395]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T12:57:50.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:50.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:50 smithi186 ceph-mon[23420]: pgmap v54: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:50 smithi186 ceph-mon[23420]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:57:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:50 smithi186 ceph-mon[23420]: osdmap e12: 2 total, 1 up, 2 in 2024-05-06T12:57:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:51 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:57:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:51 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:57:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:51 smithi186 ceph-mon[23420]: osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403] boot 2024-05-06T12:57:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:51 smithi186 ceph-mon[23420]: osdmap e13: 2 total, 2 up, 2 in 2024-05-06T12:57:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:51 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:51.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:57:51.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:57:51.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[22420]: osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403] boot 2024-05-06T12:57:51.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[22420]: osdmap e13: 2 total, 2 up, 2 in 2024-05-06T12:57:51.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:51.580 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:57:51.580 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:57:51.581 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[27395]: osd.1 [v2:172.21.15.16:6810/2971640403,v1:172.21.15.16:6811/2971640403] boot 2024-05-06T12:57:51.581 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[27395]: osdmap e13: 2 total, 2 up, 2 in 2024-05-06T12:57:51.581 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:51 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T12:57:52.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:57:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:52.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: pgmap v57: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:52.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T12:57:52.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: pgmap v57: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:52.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:52 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: pgmap v57: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: osdmap e14: 2 total, 2 up, 2 in 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:52 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi016 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[22420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:57:53.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi016 2024-05-06T12:57:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:53 smithi016 ceph-mon[27395]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi016 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:53 smithi186 ceph-mon[23420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:57:55.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[22420]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:55.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1580166612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]: dispatch 2024-05-06T12:57:55.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]: dispatch 2024-05-06T12:57:55.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]': finished 2024-05-06T12:57:55.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[22420]: osdmap e15: 3 total, 2 up, 3 in 2024-05-06T12:57:55.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:57:55.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[27395]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:55.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1580166612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]: dispatch 2024-05-06T12:57:55.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]: dispatch 2024-05-06T12:57:55.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]': finished 2024-05-06T12:57:55.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[27395]: osdmap e15: 3 total, 2 up, 3 in 2024-05-06T12:57:55.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:55 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:57:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:55 smithi186 ceph-mon[23420]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:55 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1580166612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]: dispatch 2024-05-06T12:57:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:55 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]: dispatch 2024-05-06T12:57:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:55 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7318aaf-7fb4-4d1a-becf-41f6d690dba3"}]': finished 2024-05-06T12:57:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:55 smithi186 ceph-mon[23420]: osdmap e15: 3 total, 2 up, 3 in 2024-05-06T12:57:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:55 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:57:55.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:57:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:57:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4260667744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4260667744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:56.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4260667744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:57:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:57:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:57 smithi186 ceph-mon[23420]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:57 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:57:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:57 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T12:57:57.634 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:57 smithi016 ceph-mon[22420]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:57.634 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:57 smithi016 ceph-mon[22420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:57:57.634 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:57 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T12:57:57.634 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:57 smithi016 ceph-mon[27395]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:57.634 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:57 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:57:57.634 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:57 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T12:57:59.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:57:59 smithi016 ceph-mon[22420]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:59.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:57:59 smithi016 ceph-mon[27395]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:57:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:57:59 smithi186 ceph-mon[23420]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:00.518 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:00 smithi016 ceph-mon[22420]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:00.519 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:00 smithi016 ceph-mon[27395]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:00 smithi186 ceph-mon[23420]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:02.864 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[22420]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:02.864 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T12:58:02.864 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:02.864 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[22420]: Deploying daemon osd.2 on smithi016 2024-05-06T12:58:02.864 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[27395]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:02.864 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T12:58:02.865 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:02.865 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:02 smithi016 ceph-mon[27395]: Deploying daemon osd.2 on smithi016 2024-05-06T12:58:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:02 smithi186 ceph-mon[23420]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T12:58:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:02 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:02 smithi186 ceph-mon[23420]: Deploying daemon osd.2 on smithi016 2024-05-06T12:58:03.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:58:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:58:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:58:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:03.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:58:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:58:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:58:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:58:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:04.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:04 smithi016 ceph-mon[22420]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:04.621 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:04 smithi016 ceph-mon[27395]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:04.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:04 smithi186 ceph-mon[23420]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:06.754 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:06 smithi016 ceph-mon[22420]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:06.755 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:06 smithi016 ceph-mon[27395]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:06 smithi186 ceph-mon[23420]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:08.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:08.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:07 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:07 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:07 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:07 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:07 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:07 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:09.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:08 smithi016 ceph-mon[22420]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:09.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:08 smithi016 ceph-mon[27395]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:08 smithi186 ceph-mon[23420]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:09.416 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 2 on host 'smithi016' 2024-05-06T12:58:09.996 DEBUG:teuthology.orchestra.run.smithi016:osd.2> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.2.service 2024-05-06T12:58:09.999 INFO:tasks.cephadm:Deploying osd.3 on smithi016 with /dev/vg_nvme/lv_1... 2024-05-06T12:58:09.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi016 to 5015M 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.650 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[22420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi016 to 5015M 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:10.651 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:10 smithi016 ceph-mon[27395]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi016 to 5015M 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:10 smithi186 ceph-mon[23420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T12:58:11.731 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[22420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[22420]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[22420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[27395]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[27395]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:11.732 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:11 smithi016 ceph-mon[27395]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:58:11.732 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:11 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[36507]: 2024-05-06T12:58:11.458+0000 7fb43e800700 -1 osd.2 0 waiting for initial osdmap 2024-05-06T12:58:11.733 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:11 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[36507]: 2024-05-06T12:58:11.461+0000 7fb439197700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:58:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:11 smithi186 ceph-mon[23420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T12:58:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:11 smithi186 ceph-mon[23420]: osdmap e16: 3 total, 2 up, 3 in 2024-05-06T12:58:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:11 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:11 smithi186 ceph-mon[23420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:58:12.053 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-06T12:58:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-06T12:58:12.054 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2024-05-06T12:58:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2024-05-06T12:58:12.054 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00921766 s, 1.1 GB/s 2024-05-06T12:58:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2024-05-06T12:58:12.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[22420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:58:12.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[22420]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T12:58:12.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:12.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:12.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[22420]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:12.661 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[27395]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:58:12.661 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[27395]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T12:58:12.661 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:12.661 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:12.661 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:12 smithi016 ceph-mon[27395]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:12.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_1 2024-05-06T12:58:12.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:12 smithi186 ceph-mon[23420]: from='osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:58:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:12 smithi186 ceph-mon[23420]: osdmap e17: 3 total, 2 up, 3 in 2024-05-06T12:58:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:12 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:12 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:12 smithi186 ceph-mon[23420]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818] boot 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: osdmap e18: 3 total, 3 up, 3 in 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-06T12:58:13.587 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:58:13.588 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:58:13.588 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:13.588 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818] boot 2024-05-06T12:58:13.588 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: osdmap e18: 3 total, 3 up, 3 in 2024-05-06T12:58:13.588 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:13.588 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:13 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: osd.2 [v2:172.21.15.16:6818/3605175818,v1:172.21.15.16:6819/3605175818] boot 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: osdmap e18: 3 total, 3 up, 3 in 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T12:58:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:13 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[22420]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[22420]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[27395]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T12:58:14.590 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T12:58:14.591 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:14 smithi016 ceph-mon[27395]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-06T12:58:14.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:14 smithi186 ceph-mon[23420]: osdmap e19: 3 total, 3 up, 3 in 2024-05-06T12:58:14.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-06T12:58:14.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:14 smithi186 ceph-mon[23420]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:15.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:58:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:15.675 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:58:15 smithi016 sudo[37698]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T12:58:15.675 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:58:15 smithi016 sudo[37698]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:15.675 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:58:15 smithi016 sudo[37698]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:15.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T12:58:15.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[22420]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T12:58:15.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[22420]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:58:15.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:58:15.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:58:15.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:15.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T12:58:15.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[27395]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T12:58:15.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[27395]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:58:15.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:58:15.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:58:15.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:15 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:15.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:15 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-06T12:58:15.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:15 smithi186 ceph-mon[23420]: osdmap e20: 3 total, 3 up, 3 in 2024-05-06T12:58:15.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:15 smithi186 ceph-mon[23420]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:58:15.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:15 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:58:15.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:15 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:58:15.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:15 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:16.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:58:15 smithi016 sudo[37738]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T12:58:16.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:58:15 smithi016 sudo[37738]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:16.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 12:58:15 smithi016 sudo[37738]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:16.487 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:58:16 smithi016 sudo[37777]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T12:58:16.488 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:58:16 smithi016 sudo[37777]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:16.488 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:58:16 smithi016 sudo[37777]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:16.488 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi016 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:16.746 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi016 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.747 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: osdmap e21: 3 total, 3 up, 3 in 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi016 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:17.055 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:58:16 smithi016 sudo[37791]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T12:58:17.055 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:58:16 smithi016 sudo[37791]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:17.056 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 12:58:16 smithi016 sudo[37791]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:17.424 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:17 smithi016 sudo[37852]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T12:58:17.424 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:17 smithi016 sudo[37852]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:17.424 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:17 smithi016 sudo[37852]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:17.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:17 smithi186 ceph-mon[23420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:58:17.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:17 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/33088445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6341fe44-e6d9-40ca-8e63-6b232680a41c"}]: dispatch 2024-05-06T12:58:17.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:17 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/33088445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6341fe44-e6d9-40ca-8e63-6b232680a41c"}]': finished 2024-05-06T12:58:17.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:17 smithi186 ceph-mon[23420]: osdmap e22: 4 total, 3 up, 4 in 2024-05-06T12:58:17.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:17 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:17.819 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[22420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:58:17.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/33088445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6341fe44-e6d9-40ca-8e63-6b232680a41c"}]: dispatch 2024-05-06T12:58:17.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/33088445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6341fe44-e6d9-40ca-8e63-6b232680a41c"}]': finished 2024-05-06T12:58:17.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[22420]: osdmap e22: 4 total, 3 up, 4 in 2024-05-06T12:58:17.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:17.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:17 smithi016 sudo[37864]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T12:58:17.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:17 smithi016 sudo[37864]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:17.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 12:58:17 smithi016 sudo[37864]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:17.820 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[27395]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:58:17.820 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/33088445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6341fe44-e6d9-40ca-8e63-6b232680a41c"}]: dispatch 2024-05-06T12:58:17.821 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/33088445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6341fe44-e6d9-40ca-8e63-6b232680a41c"}]': finished 2024-05-06T12:58:17.821 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[27395]: osdmap e22: 4 total, 3 up, 4 in 2024-05-06T12:58:17.821 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:17 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 sudo[37988]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T12:58:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 sudo[37988]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 sudo[37988]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:18 smithi016 ceph-mon[27395]: mgrmap e15: y(active, since 2m), standbys: x 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:18 smithi016 ceph-mon[27395]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 sudo[38043]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 sudo[38043]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 sudo[38043]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 ceph-mon[22420]: mgrmap e15: y(active, since 2m), standbys: x 2024-05-06T12:58:18.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:18 smithi016 ceph-mon[22420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:18 smithi186 ceph-mon[23420]: mgrmap e15: y(active, since 2m), standbys: x 2024-05-06T12:58:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:18 smithi186 ceph-mon[23420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:19.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:19 smithi016 sudo[38416]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T12:58:19.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:19 smithi016 sudo[38416]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:19.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:19 smithi016 sudo[38416]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:19.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:19 smithi016 sudo[38606]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T12:58:19.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:19 smithi016 sudo[38606]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:19.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:19 smithi016 sudo[38606]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:20.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:19 smithi186 sudo[25867]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-06T12:58:20.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:19 smithi186 sudo[25867]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:20.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:19 smithi186 sudo[25867]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:20.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 sudo[25870]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-06T12:58:20.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 sudo[25870]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-06T12:58:20.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 sudo[25870]: pam_unix(sudo:session): session closed for user root 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4159083982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:20.364 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:58:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:20.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:20.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4159083982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.365 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4159083982' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:20.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:58:21.372 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:58:21.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:21 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:58:21.413 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:21 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T12:58:23.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:23 smithi016 ceph-mon[22420]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 190 KiB/s wr, 13 op/s 2024-05-06T12:58:23.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:23 smithi016 ceph-mon[27395]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 190 KiB/s wr, 13 op/s 2024-05-06T12:58:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:23 smithi186 ceph-mon[23420]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 190 KiB/s wr, 13 op/s 2024-05-06T12:58:23.653 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:58:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:24.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:24.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:24.697 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:24 smithi186 ceph-mon[23420]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 128 KiB/s wr, 9 op/s 2024-05-06T12:58:24.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:24.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:24.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:24 smithi016 ceph-mon[22420]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 128 KiB/s wr, 9 op/s 2024-05-06T12:58:24.878 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:24.878 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:24.878 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:24 smithi016 ceph-mon[27395]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 128 KiB/s wr, 9 op/s 2024-05-06T12:58:25.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T12:58:25.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:25 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:25.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:25 smithi016 ceph-mon[22420]: Deploying daemon osd.3 on smithi016 2024-05-06T12:58:25.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T12:58:25.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:25 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:25.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:25 smithi016 ceph-mon[27395]: Deploying daemon osd.3 on smithi016 2024-05-06T12:58:25.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T12:58:25.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:25 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:25.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:25 smithi186 ceph-mon[23420]: Deploying daemon osd.3 on smithi016 2024-05-06T12:58:26.736 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:26 smithi186 ceph-mon[23420]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 96 KiB/s wr, 6 op/s 2024-05-06T12:58:26.864 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:26 smithi016 ceph-mon[22420]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 96 KiB/s wr, 6 op/s 2024-05-06T12:58:26.864 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:26 smithi016 ceph-mon[27395]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 96 KiB/s wr, 6 op/s 2024-05-06T12:58:28.846 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:28 smithi016 ceph-mon[22420]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 77 KiB/s wr, 5 op/s 2024-05-06T12:58:28.847 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:28 smithi016 ceph-mon[27395]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 77 KiB/s wr, 5 op/s 2024-05-06T12:58:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:28 smithi186 ceph-mon[23420]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 77 KiB/s wr, 5 op/s 2024-05-06T12:58:31.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[22420]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[27395]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:31.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:31.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:31.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:31 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:31 smithi186 ceph-mon[23420]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T12:58:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:31 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:31 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:31 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:31 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:31 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:32.692 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 3 on host 'smithi016' 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.329 DEBUG:teuthology.orchestra.run.smithi016:osd.3> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3.service 2024-05-06T12:58:33.332 INFO:tasks.cephadm:Deploying osd.4 on smithi186 with /dev/vg_nvme/lv_4... 2024-05-06T12:58:33.332 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-06T12:58:33.360 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:33.361 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:34.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:34 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi016 to 3761M 2024-05-06T12:58:34.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:34 smithi186 ceph-mon[23420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T12:58:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:34 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi016 to 3761M 2024-05-06T12:58:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:34 smithi016 ceph-mon[27395]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T12:58:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:34 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi016 to 3761M 2024-05-06T12:58:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:34 smithi016 ceph-mon[22420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T12:58:35.199 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-06T12:58:35.199 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-06T12:58:35.199 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-05-06T12:58:35.199 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-05-06T12:58:35.199 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114378 s, 917 MB/s 2024-05-06T12:58:35.199 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-05-06T12:58:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[22420]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[22420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[22420]: osdmap e23: 4 total, 3 up, 4 in 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[22420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[27395]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[27395]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[27395]: osdmap e23: 4 total, 3 up, 4 in 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:35.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:35 smithi016 ceph-mon[27395]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:58:35.426 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 12:58:35 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[39486]: 2024-05-06T12:58:35.038+0000 7fa192c4f700 -1 osd.3 0 waiting for initial osdmap 2024-05-06T12:58:35.426 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 12:58:35 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[39486]: 2024-05-06T12:58:35.042+0000 7fa18bde3700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:58:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:35 smithi186 ceph-mon[23420]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:35 smithi186 ceph-mon[23420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T12:58:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:35 smithi186 ceph-mon[23420]: osdmap e23: 4 total, 3 up, 4 in 2024-05-06T12:58:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:35 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:35 smithi186 ceph-mon[23420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T12:58:35.798 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_4 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[22420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[22420]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[27395]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[27395]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T12:58:36.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:36.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:36 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:36.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:36 smithi186 ceph-mon[23420]: from='osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-05-06T12:58:36.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:36 smithi186 ceph-mon[23420]: osdmap e24: 4 total, 3 up, 4 in 2024-05-06T12:58:36.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:36 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:36.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:36 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:36.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:58:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:37.259 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119] boot 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: osdmap e25: 4 total, 4 up, 4 in 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:37.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:58:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:58:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119] boot 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: osdmap e25: 4 total, 4 up, 4 in 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: osd.3 [v2:172.21.15.16:6826/1302090119,v1:172.21.15.16:6827/1302090119] boot 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: osdmap e25: 4 total, 4 up, 4 in 2024-05-06T12:58:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T12:58:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:38.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi016 2024-05-06T12:58:38.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[22420]: osdmap e26: 4 total, 4 up, 4 in 2024-05-06T12:58:38.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:58:38.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:58:38.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:38.202 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi016 2024-05-06T12:58:38.203 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[27395]: osdmap e26: 4 total, 4 up, 4 in 2024-05-06T12:58:38.203 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:58:38.203 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:58:38.203 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:38 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:38.372 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:38 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi016 2024-05-06T12:58:38.372 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:38 smithi186 ceph-mon[23420]: osdmap e26: 4 total, 4 up, 4 in 2024-05-06T12:58:38.373 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:38 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:58:38.373 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:38 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:58:38.373 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:38 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:39.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:39 smithi186 ceph-mon[23420]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:39.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:39 smithi186 ceph-mon[23420]: from='client.34217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:58:39.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:39 smithi016 ceph-mon[22420]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:39.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:39 smithi016 ceph-mon[22420]: from='client.34217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:58:39.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:39 smithi016 ceph-mon[27395]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:39.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:39 smithi016 ceph-mon[27395]: from='client.34217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:58:40.410 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[22420]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:40.410 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/1915983568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]: dispatch 2024-05-06T12:58:40.410 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]: dispatch 2024-05-06T12:58:40.410 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]': finished 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[22420]: osdmap e27: 5 total, 4 up, 5 in 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[27395]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/1915983568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]: dispatch 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]: dispatch 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]': finished 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[27395]: osdmap e27: 5 total, 4 up, 5 in 2024-05-06T12:58:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:40 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:40 smithi186 ceph-mon[23420]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:40 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/1915983568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]: dispatch 2024-05-06T12:58:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:40 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]: dispatch 2024-05-06T12:58:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:40 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b24312dd-6e26-445e-bb18-51bd2ca04937"}]': finished 2024-05-06T12:58:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:40 smithi186 ceph-mon[23420]: osdmap e27: 5 total, 4 up, 5 in 2024-05-06T12:58:40.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:40 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:41.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:41 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/3473617871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:58:41.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:41 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/3473617871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:58:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:41 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/3473617871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:58:42.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:42 smithi186 ceph-mon[23420]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:42.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:42 smithi016 ceph-mon[22420]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:42.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:42 smithi016 ceph-mon[27395]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:43.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:58:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:44.750 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:44 smithi186 ceph-mon[23420]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:44.750 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:44 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:44.750 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:44 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:44.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:44 smithi016 ceph-mon[22420]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:44.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:44 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:44.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:44 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:44.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:44 smithi016 ceph-mon[27395]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:44.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:44 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:44.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:44 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:46.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:46 smithi186 ceph-mon[23420]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:46.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:46 smithi016 ceph-mon[22420]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:46 smithi016 ceph-mon[27395]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:47.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T12:58:47.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:47.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:47 smithi016 ceph-mon[22420]: Deploying daemon osd.4 on smithi186 2024-05-06T12:58:47.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T12:58:47.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:47.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:47 smithi016 ceph-mon[27395]: Deploying daemon osd.4 on smithi186 2024-05-06T12:58:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T12:58:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:47 smithi186 ceph-mon[23420]: Deploying daemon osd.4 on smithi186 2024-05-06T12:58:48.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:48 smithi016 ceph-mon[22420]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:48.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:48 smithi016 ceph-mon[27395]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:48 smithi186 ceph-mon[23420]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:50.506 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:50 smithi186 ceph-mon[23420]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:50 smithi016 ceph-mon[22420]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:50.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:50 smithi016 ceph-mon[27395]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:52.825 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:52 smithi186 ceph-mon[23420]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:52.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:52 smithi016 ceph-mon[22420]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:52.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:52 smithi016 ceph-mon[27395]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:53.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:58:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:58:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:58:54.065 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:54.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:54.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:54.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:53 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:54.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:54.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:54.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:54.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:54.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:53 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:54 smithi016 ceph-mon[22420]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:54 smithi016 ceph-mon[27395]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:55.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:54 smithi186 ceph-mon[23420]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:55.422 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 4 on host 'smithi186' 2024-05-06T12:58:56.016 DEBUG:teuthology.orchestra.run.smithi186:osd.4> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4.service 2024-05-06T12:58:56.019 INFO:tasks.cephadm:Deploying osd.5 on smithi186 with /dev/vg_nvme/lv_3... 2024-05-06T12:58:56.019 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi186 to 16064M 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:56.630 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T12:58:56.631 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:56 smithi186 ceph-mon[23420]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T12:58:56.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:56.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:56.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi186 to 16064M 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T12:58:56.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[22420]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi186 to 16064M 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T12:58:56.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:56 smithi016 ceph-mon[27395]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T12:58:57.730 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:57 smithi186 ceph-mon[23420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T12:58:57.730 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:57 smithi186 ceph-mon[23420]: osdmap e28: 5 total, 4 up, 5 in 2024-05-06T12:58:57.730 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:57 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:57.730 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:57 smithi186 ceph-mon[23420]: from='osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:58:57.731 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:57 smithi186 ceph-mon[23420]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:58:57.731 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 12:58:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[28072]: 2024-05-06T12:58:57.447+0000 7f07a991c700 -1 osd.4 0 waiting for initial osdmap 2024-05-06T12:58:57.731 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 12:58:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[28072]: 2024-05-06T12:58:57.453+0000 7f07a22af700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[22420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[22420]: osdmap e28: 5 total, 4 up, 5 in 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[22420]: from='osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[22420]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[27395]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T12:58:57.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[27395]: osdmap e28: 5 total, 4 up, 5 in 2024-05-06T12:58:57.899 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:57.899 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[27395]: from='osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:58:57.899 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:57 smithi016 ceph-mon[27395]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:58:58.236 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-06T12:58:58.236 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-06T12:58:58.236 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-05-06T12:58:58.236 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-05-06T12:58:58.236 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126316 s, 830 MB/s 2024-05-06T12:58:58.236 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-05-06T12:58:58.647 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:58 smithi186 ceph-mon[23420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:58:58.647 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:58 smithi186 ceph-mon[23420]: osdmap e29: 5 total, 4 up, 5 in 2024-05-06T12:58:58.647 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:58 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:58.647 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:58 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:58.648 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:58 smithi186 ceph-mon[23420]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[22420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:58:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[22420]: osdmap e29: 5 total, 4 up, 5 in 2024-05-06T12:58:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:58.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[22420]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:58.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[27395]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:58:58.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[27395]: osdmap e29: 5 total, 4 up, 5 in 2024-05-06T12:58:58.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:58.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:58.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:58 smithi016 ceph-mon[27395]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-06T12:58:58.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_3 2024-05-06T12:58:59.746 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:59 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:58:59.746 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:59 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:58:59.746 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:59 smithi186 ceph-mon[23420]: osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305] boot 2024-05-06T12:58:59.746 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:59 smithi186 ceph-mon[23420]: osdmap e30: 5 total, 5 up, 5 in 2024-05-06T12:58:59.747 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:59 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:59.747 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:58:59 smithi186 ceph-mon[23420]: osdmap e31: 5 total, 5 up, 5 in 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[22420]: osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305] boot 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[22420]: osdmap e30: 5 total, 5 up, 5 in 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[22420]: osdmap e31: 5 total, 5 up, 5 in 2024-05-06T12:58:59.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:58:59.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:58:59.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[27395]: osd.4 [v2:172.21.15.186:6800/3576436305,v1:172.21.15.186:6801/3576436305] boot 2024-05-06T12:58:59.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[27395]: osdmap e30: 5 total, 5 up, 5 in 2024-05-06T12:58:59.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T12:58:59.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:58:59 smithi016 ceph-mon[27395]: osdmap e31: 5 total, 5 up, 5 in 2024-05-06T12:59:00.703 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:00 smithi186 ceph-mon[23420]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:00.704 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:00 smithi186 ceph-mon[23420]: osdmap e32: 5 total, 5 up, 5 in 2024-05-06T12:59:00.825 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:00 smithi016 ceph-mon[22420]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:00.825 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:00 smithi016 ceph-mon[22420]: osdmap e32: 5 total, 5 up, 5 in 2024-05-06T12:59:00.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:00 smithi016 ceph-mon[27395]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:00.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:00 smithi016 ceph-mon[27395]: osdmap e32: 5 total, 5 up, 5 in 2024-05-06T12:59:01.682 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:01 smithi186 ceph-mon[23420]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:01.682 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:01 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:01.682 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:01 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:01.682 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:01 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:01.682 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:01 smithi186 ceph-mon[23420]: osdmap e33: 5 total, 5 up, 5 in 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[27395]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[27395]: osdmap e33: 5 total, 5 up, 5 in 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[22420]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:01.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:01.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:01.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:01 smithi016 ceph-mon[22420]: osdmap e33: 5 total, 5 up, 5 in 2024-05-06T12:59:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:02 smithi186 ceph-mon[23420]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-06T12:59:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:02 smithi186 ceph-mon[23420]: osdmap e34: 5 total, 5 up, 5 in 2024-05-06T12:59:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:02 smithi016 ceph-mon[22420]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-06T12:59:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:02 smithi016 ceph-mon[22420]: osdmap e34: 5 total, 5 up, 5 in 2024-05-06T12:59:02.925 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T12:59:02.659+0000 7f390d44c700 -1 calc_pg_upmaps abort due to max <= 0 2024-05-06T12:59:02.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:02 smithi016 ceph-mon[27395]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-06T12:59:02.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:02 smithi016 ceph-mon[27395]: osdmap e34: 5 total, 5 up, 5 in 2024-05-06T12:59:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:59:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:59:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/388546791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]: dispatch 2024-05-06T12:59:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]: dispatch 2024-05-06T12:59:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]': finished 2024-05-06T12:59:03.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: osdmap e35: 6 total, 5 up, 6 in 2024-05-06T12:59:03.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:03.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:59:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:59:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:59:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/388546791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]: dispatch 2024-05-06T12:59:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]: dispatch 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]': finished 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: osdmap e35: 6 total, 5 up, 6 in 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/388546791' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]: dispatch 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]: dispatch 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85"}]': finished 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: osdmap e35: 6 total, 5 up, 6 in 2024-05-06T12:59:03.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi186 2024-05-06T12:59:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[22420]: pgmap v117: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-06T12:59:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/1994775458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi186 2024-05-06T12:59:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[27395]: pgmap v117: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-06T12:59:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:04 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/1994775458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:04 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:04 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi186 2024-05-06T12:59:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:04 smithi186 ceph-mon[23420]: pgmap v117: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-06T12:59:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:04 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:04 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/1994775458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:06.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:06 smithi186 ceph-mon[23420]: pgmap v118: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-06T12:59:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:06 smithi016 ceph-mon[22420]: pgmap v118: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-06T12:59:06.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:06 smithi016 ceph-mon[27395]: pgmap v118: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-06T12:59:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:08 smithi186 ceph-mon[23420]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:08 smithi016 ceph-mon[22420]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:08.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:08 smithi016 ceph-mon[27395]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:10 smithi186 ceph-mon[23420]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:10.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:10 smithi016 ceph-mon[22420]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:10.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:10 smithi016 ceph-mon[27395]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:11.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:11 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T12:59:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:11 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:11 smithi186 ceph-mon[23420]: Deploying daemon osd.5 on smithi186 2024-05-06T12:59:11.586 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:11 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T12:59:11.587 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:11 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:11.587 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:11 smithi016 ceph-mon[22420]: Deploying daemon osd.5 on smithi186 2024-05-06T12:59:11.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:11 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T12:59:11.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:11 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:11.587 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:11 smithi016 ceph-mon[27395]: Deploying daemon osd.5 on smithi186 2024-05-06T12:59:12.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:12 smithi016 ceph-mon[22420]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:12.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:12 smithi016 ceph-mon[27395]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:12.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:12 smithi186 ceph-mon[23420]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:14.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:59:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:14.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:14 smithi016 ceph-mon[22420]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:14.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:14.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:14.877 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:14 smithi016 ceph-mon[27395]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:14.877 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:14.877 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:14.951 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:14 smithi186 ceph-mon[23420]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:14.951 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:14.951 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:16 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:16 smithi186 ceph-mon[23420]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:16.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[22420]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:16.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:16 smithi016 ceph-mon[27395]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:18.134 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 5 on host 'smithi186' 2024-05-06T12:59:18.814 DEBUG:teuthology.orchestra.run.smithi186:osd.5> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5.service 2024-05-06T12:59:18.816 INFO:tasks.cephadm:Deploying osd.6 on smithi186 with /dev/vg_nvme/lv_2... 2024-05-06T12:59:18.817 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-06T12:59:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi186 to 8032M 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[22420]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi186 to 8032M 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T12:59:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:19 smithi016 ceph-mon[27395]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T12:59:19.458 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:19.458 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.458 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:19.458 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi186 to 8032M 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T12:59:19.459 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:19 smithi186 ceph-mon[23420]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T12:59:20.306 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:20 smithi186 ceph-mon[23420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T12:59:20.306 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:20 smithi186 ceph-mon[23420]: osdmap e36: 6 total, 5 up, 6 in 2024-05-06T12:59:20.306 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:20 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:20.306 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:20 smithi186 ceph-mon[23420]: from='osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:20.306 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:20 smithi186 ceph-mon[23420]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:20.306 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 12:59:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[30955]: 2024-05-06T12:59:20.156+0000 7f26847b5700 -1 osd.5 0 waiting for initial osdmap 2024-05-06T12:59:20.306 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 12:59:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[30955]: 2024-05-06T12:59:20.160+0000 7f2681150700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:59:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[22420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T12:59:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[22420]: osdmap e36: 6 total, 5 up, 6 in 2024-05-06T12:59:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[22420]: from='osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[22420]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[27395]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T12:59:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[27395]: osdmap e36: 6 total, 5 up, 6 in 2024-05-06T12:59:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[27395]: from='osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:20 smithi016 ceph-mon[27395]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:20.768 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-06T12:59:20.769 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-06T12:59:20.769 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-05-06T12:59:20.769 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-05-06T12:59:20.769 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0145458 s, 721 MB/s 2024-05-06T12:59:20.769 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-05-06T12:59:21.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:21 smithi186 ceph-mon[23420]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:21.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:21 smithi186 ceph-mon[23420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:59:21.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:21 smithi186 ceph-mon[23420]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T12:59:21.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:21 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:21.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:21 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[22420]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[22420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[22420]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[27395]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[27395]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:59:21.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[27395]: osdmap e37: 6 total, 5 up, 6 in 2024-05-06T12:59:21.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:21.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:21 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:21.426 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_2 2024-05-06T12:59:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:22 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:59:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:22 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:59:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:22 smithi186 ceph-mon[23420]: osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579] boot 2024-05-06T12:59:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:22 smithi186 ceph-mon[23420]: osdmap e38: 6 total, 6 up, 6 in 2024-05-06T12:59:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:22 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:22 smithi186 ceph-mon[23420]: osdmap e39: 6 total, 6 up, 6 in 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[22420]: osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579] boot 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[22420]: osdmap e38: 6 total, 6 up, 6 in 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[22420]: osdmap e39: 6 total, 6 up, 6 in 2024-05-06T12:59:22.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:59:22.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:59:22.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[27395]: osd.5 [v2:172.21.15.186:6808/2132738579,v1:172.21.15.186:6809/2132738579] boot 2024-05-06T12:59:22.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[27395]: osdmap e38: 6 total, 6 up, 6 in 2024-05-06T12:59:22.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T12:59:22.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:22 smithi016 ceph-mon[27395]: osdmap e39: 6 total, 6 up, 6 in 2024-05-06T12:59:23.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:23 smithi186 ceph-mon[23420]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:23.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:23 smithi186 ceph-mon[23420]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T12:59:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:23 smithi016 ceph-mon[22420]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:23 smithi016 ceph-mon[22420]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T12:59:23.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:23 smithi016 ceph-mon[27395]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-06T12:59:23.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:23 smithi016 ceph-mon[27395]: osdmap e40: 6 total, 6 up, 6 in 2024-05-06T12:59:23.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:59:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:24 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:24 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:25.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:25 smithi186 ceph-mon[23420]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:25.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:25 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi186 2024-05-06T12:59:25.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:25 smithi186 ceph-mon[23420]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:25.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:25 smithi186 ceph-mon[23420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:59:25.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:25 smithi186 ceph-mon[23420]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T12:59:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[22420]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi186 2024-05-06T12:59:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[22420]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[22420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:59:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[22420]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T12:59:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[27395]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:25.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi186 2024-05-06T12:59:25.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[27395]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:25.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[27395]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:59:25.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:25 smithi016 ceph-mon[27395]: osdmap e41: 6 total, 6 up, 6 in 2024-05-06T12:59:26.507 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:26 smithi186 ceph-mon[23420]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T12:59:26.507 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:26 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/2979432660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]: dispatch 2024-05-06T12:59:26.508 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:26 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]: dispatch 2024-05-06T12:59:26.508 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:26 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]': finished 2024-05-06T12:59:26.508 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:26 smithi186 ceph-mon[23420]: osdmap e43: 7 total, 6 up, 7 in 2024-05-06T12:59:26.508 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:26 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[22420]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/2979432660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]: dispatch 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]: dispatch 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]': finished 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[22420]: osdmap e43: 7 total, 6 up, 7 in 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:26.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[27395]: osdmap e42: 6 total, 6 up, 6 in 2024-05-06T12:59:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/2979432660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]: dispatch 2024-05-06T12:59:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]: dispatch 2024-05-06T12:59:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91229d99-e5ab-42ab-839e-ea3452c09847"}]': finished 2024-05-06T12:59:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[27395]: osdmap e43: 7 total, 6 up, 7 in 2024-05-06T12:59:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:26 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:27.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:26 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:59:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:27.451 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:27.451 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/7025210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:27.451 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/7025210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:27.452 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:27.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:27.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:27.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:27 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/7025210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:27.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:27 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:28 smithi186 ceph-mon[23420]: pgmap v138: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:28 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:59:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:28 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T12:59:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:28 smithi016 ceph-mon[22420]: pgmap v138: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:28 smithi016 ceph-mon[22420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:59:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:28 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T12:59:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:28 smithi016 ceph-mon[27395]: pgmap v138: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:28 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:59:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:28 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T12:59:30.371 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:30 smithi186 ceph-mon[23420]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:30.476 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:30 smithi016 ceph-mon[22420]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:30.477 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:30 smithi016 ceph-mon[27395]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:32 smithi186 ceph-mon[23420]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:32.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:32 smithi016 ceph-mon[22420]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:32.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:32 smithi016 ceph-mon[27395]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:33.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T12:59:33.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:33 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:33.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T12:59:33.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:33 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T12:59:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:33 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:34.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:59:33] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:34.481 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:34 smithi186 ceph-mon[23420]: Deploying daemon osd.6 on smithi186 2024-05-06T12:59:34.481 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:34 smithi186 ceph-mon[23420]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:34.481 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:34 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:34.481 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:34 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[27395]: Deploying daemon osd.6 on smithi186 2024-05-06T12:59:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[27395]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:34.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[22420]: Deploying daemon osd.6 on smithi186 2024-05-06T12:59:34.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[22420]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:34.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:34.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:34 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:35 smithi186 ceph-mon[23420]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:35.621 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:35 smithi016 ceph-mon[22420]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:35.621 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:35 smithi016 ceph-mon[27395]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:37.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:37 smithi186 ceph-mon[23420]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:37.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:37.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:37.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:37.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:37.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:37 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:38.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[22420]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:38.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:38.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:38.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:38.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[27395]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:38.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:38.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:37 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:40.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:39 smithi186 ceph-mon[23420]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:40.071 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 6 on host 'smithi186' 2024-05-06T12:59:40.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:39 smithi016 ceph-mon[22420]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:39 smithi016 ceph-mon[27395]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:40.682 DEBUG:teuthology.orchestra.run.smithi186:osd.6> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6.service 2024-05-06T12:59:40.684 INFO:tasks.cephadm:Deploying osd.7 on smithi186 with /dev/vg_nvme/lv_1... 2024-05-06T12:59:40.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-06T12:59:41.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:41.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:41.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:41.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.339 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.339 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi186 to 5354M 2024-05-06T12:59:41.339 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.339 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.339 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T12:59:41.339 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:41 smithi186 ceph-mon[23420]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T12:59:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi186 to 5354M 2024-05-06T12:59:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T12:59:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[22420]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T12:59:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi186 to 5354M 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T12:59:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:41 smithi016 ceph-mon[27395]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T12:59:42.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:42 smithi186 ceph-mon[23420]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:42.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:42 smithi186 ceph-mon[23420]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T12:59:42.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:42 smithi186 ceph-mon[23420]: osdmap e44: 7 total, 6 up, 7 in 2024-05-06T12:59:42.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:42 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:42.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:42 smithi186 ceph-mon[23420]: from='osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:42.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:42 smithi186 ceph-mon[23420]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:42.257 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 12:59:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[33852]: 2024-05-06T12:59:42.121+0000 7f3835736700 -1 osd.6 0 waiting for initial osdmap 2024-05-06T12:59:42.257 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 12:59:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[33852]: 2024-05-06T12:59:42.128+0000 7f38300cd700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T12:59:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[22420]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[22420]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T12:59:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[22420]: osdmap e44: 7 total, 6 up, 7 in 2024-05-06T12:59:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[22420]: from='osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[22420]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[27395]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[27395]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T12:59:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[27395]: osdmap e44: 7 total, 6 up, 7 in 2024-05-06T12:59:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[27395]: from='osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:42 smithi016 ceph-mon[27395]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T12:59:42.722 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-06T12:59:42.722 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-06T12:59:42.722 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-05-06T12:59:42.722 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-05-06T12:59:42.722 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128347 s, 817 MB/s 2024-05-06T12:59:42.722 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-05-06T12:59:43.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:43 smithi186 ceph-mon[23420]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:59:43.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:43 smithi186 ceph-mon[23420]: osdmap e45: 7 total, 6 up, 7 in 2024-05-06T12:59:43.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:43 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:43.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:43 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:43.422 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi186:vg_nvme/lv_1 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[22420]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[22420]: osdmap e45: 7 total, 6 up, 7 in 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[27395]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[27395]: osdmap e45: 7 total, 6 up, 7 in 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:43 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918] boot 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: osdmap e46: 7 total, 7 up, 7 in 2024-05-06T12:59:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:44 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T12:59:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T12:59:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918] boot 2024-05-06T12:59:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: osdmap e46: 7 total, 7 up, 7 in 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: osd.6 [v2:172.21.15.186:6816/607270918,v1:172.21.15.186:6817/607270918] boot 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: osdmap e46: 7 total, 7 up, 7 in 2024-05-06T12:59:44.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:44 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T12:59:45.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:45 smithi186 ceph-mon[23420]: osdmap e47: 7 total, 7 up, 7 in 2024-05-06T12:59:45.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:45 smithi016 ceph-mon[22420]: osdmap e47: 7 total, 7 up, 7 in 2024-05-06T12:59:45.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:45 smithi016 ceph-mon[27395]: osdmap e47: 7 total, 7 up, 7 in 2024-05-06T12:59:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[22420]: pgmap v151: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[22420]: osdmap e48: 7 total, 7 up, 7 in 2024-05-06T12:59:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[22420]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:46.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[27395]: pgmap v151: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:46.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[27395]: osdmap e48: 7 total, 7 up, 7 in 2024-05-06T12:59:46.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[27395]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:46.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:46.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:46.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:46 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:46.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:46 smithi186 ceph-mon[23420]: pgmap v151: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:46.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:46 smithi186 ceph-mon[23420]: osdmap e48: 7 total, 7 up, 7 in 2024-05-06T12:59:46.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:46 smithi186 ceph-mon[23420]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T12:59:46.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:46 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-06T12:59:46.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:46 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-06T12:59:46.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:46 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:47.327 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:59:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: osdmap e49: 7 total, 7 up, 7 in 2024-05-06T12:59:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi186 2024-05-06T12:59:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: osdmap e49: 7 total, 7 up, 7 in 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi186 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:47.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:47.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:47 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.701 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: osdmap e49: 7 total, 7 up, 7 in 2024-05-06T12:59:47.701 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: pgmap v154: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi186 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:47.702 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:47 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: osdmap e50: 7 total, 7 up, 7 in 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/3204453685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]: dispatch 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]: dispatch 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]': finished 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: osdmap e51: 8 total, 7 up, 8 in 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T12:59:48.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:48 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/1182734128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: osdmap e50: 7 total, 7 up, 7 in 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/3204453685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]: dispatch 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]: dispatch 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]': finished 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: osdmap e51: 8 total, 7 up, 8 in 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T12:59:48.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/1182734128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: osdmap e50: 7 total, 7 up, 7 in 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/3204453685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]: dispatch 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]: dispatch 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bf1d457-c776-4ef2-967f-7b8c7198e7e1"}]': finished 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: osdmap e51: 8 total, 7 up, 8 in 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T12:59:48.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:48 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/1182734128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-06T12:59:49.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:12:59:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: pgmap v158: 1 pgs: 1 remapped+peering; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: pgmap v158: 1 pgs: 1 remapped+peering; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:50.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:50 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: pgmap v158: 1 pgs: 1 remapped+peering; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T12:59:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:50 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:51.431 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:51 smithi186 ceph-mon[23420]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 172 KiB/s, 0 objects/s recovering 2024-05-06T12:59:51.431 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:51 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:59:51.431 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:51 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T12:59:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:51 smithi016 ceph-mon[22420]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 172 KiB/s, 0 objects/s recovering 2024-05-06T12:59:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:51 smithi016 ceph-mon[22420]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:59:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:51 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T12:59:51.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:51 smithi016 ceph-mon[27395]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 172 KiB/s, 0 objects/s recovering 2024-05-06T12:59:51.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:51 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-06T12:59:51.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:51 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T12:59:53.428 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:53 smithi186 ceph-mon[23420]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-05-06T12:59:53.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:53 smithi016 ceph-mon[22420]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-05-06T12:59:53.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:53 smithi016 ceph-mon[27395]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-05-06T12:59:54.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 12:59:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:12:59:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T12:59:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[22420]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-06T12:59:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T12:59:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[27395]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:54 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:54 smithi186 ceph-mon[23420]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:54 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:54 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T12:59:55.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:54 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T12:59:55.176 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:54 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T12:59:56.153 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:55 smithi186 ceph-mon[23420]: Deploying daemon osd.7 on smithi186 2024-05-06T12:59:56.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:55 smithi016 ceph-mon[22420]: Deploying daemon osd.7 on smithi186 2024-05-06T12:59:56.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:55 smithi016 ceph-mon[27395]: Deploying daemon osd.7 on smithi186 2024-05-06T12:59:57.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:56 smithi016 ceph-mon[22420]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-06T12:59:57.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:56 smithi016 ceph-mon[27395]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-06T12:59:57.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:56 smithi186 ceph-mon[23420]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-06T12:59:58.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 12:59:58 smithi016 ceph-mon[22420]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-06T12:59:58.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 12:59:58 smithi016 ceph-mon[27395]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-06T12:59:59.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 12:59:58 smithi186 ceph-mon[23420]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:00 smithi186 ceph-mon[23420]: overall HEALTH_OK 2024-05-06T13:00:00.825 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[22420]: overall HEALTH_OK 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:00.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:00.827 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:00.827 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:00.827 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:00 smithi016 ceph-mon[27395]: overall HEALTH_OK 2024-05-06T13:00:02.238 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 7 on host 'smithi186' 2024-05-06T13:00:02.897 DEBUG:teuthology.orchestra.run.smithi186:osd.7> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.7.service 2024-05-06T13:00:02.900 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-05-06T13:00:02.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi186 to 4016M 2024-05-06T13:00:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:00:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:00:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:03 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:03.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: Adjusting osd_memory_target on smithi186 to 4016M 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:00:03.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:03.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi186 to 4016M 2024-05-06T13:00:03.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:03.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:00:03.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:00:03.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:03.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:03 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[22420]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-06T13:00:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[22420]: osdmap e52: 8 total, 7 up, 8 in 2024-05-06T13:00:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[22420]: from='osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:00:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[22420]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:00:04.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[27395]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-06T13:00:04.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[27395]: osdmap e52: 8 total, 7 up, 8 in 2024-05-06T13:00:04.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:04.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[27395]: from='osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:00:04.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:04 smithi016 ceph-mon[27395]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:00:04.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:04 smithi186 ceph-mon[23420]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-06T13:00:04.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:04 smithi186 ceph-mon[23420]: osdmap e52: 8 total, 7 up, 8 in 2024-05-06T13:00:04.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:04 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:04.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:04 smithi186 ceph-mon[23420]: from='osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:00:04.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:04 smithi186 ceph-mon[23420]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:00:04.767 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:00:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[36800]: 2024-05-06T13:00:04.286+0000 7f544affb700 -1 osd.7 0 waiting for initial osdmap 2024-05-06T13:00:04.767 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:00:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[36800]: 2024-05-06T13:00:04.294+0000 7f5446994700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:00:04.886 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:00:05.521 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T13:00:05.521 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T13:00:05.521 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: osdmap e53: 8 total, 7 up, 8 in 2024-05-06T13:00:05.521 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.521 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563] boot 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: osdmap e54: 8 total, 8 up, 8 in 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3177872387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: osdmap e53: 8 total, 7 up, 8 in 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563] boot 2024-05-06T13:00:05.522 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: osdmap e54: 8 total, 8 up, 8 in 2024-05-06T13:00:05.523 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.523 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:05 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3177872387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:00:05.546 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1715000404,"num_in_osds":8,"osd_in_since":1715000387,"num_remapped_pgs":1} 2024-05-06T13:00:05.546 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T13:00:05.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-06T13:00:05.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-05-06T13:00:05.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: osdmap e53: 8 total, 7 up, 8 in 2024-05-06T13:00:05.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: osd.7 [v2:172.21.15.186:6824/3651075563,v1:172.21.15.186:6825/3651075563] boot 2024-05-06T13:00:05.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: osdmap e54: 8 total, 8 up, 8 in 2024-05-06T13:00:05.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:05.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:05 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3177872387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-06T13:00:05.768 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[22420]: purged_snaps scrub starts 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[22420]: purged_snaps scrub ok 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[22420]: osdmap e55: 8 total, 8 up, 8 in 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[22420]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[27395]: purged_snaps scrub starts 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[27395]: purged_snaps scrub ok 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[27395]: osdmap e55: 8 total, 8 up, 8 in 2024-05-06T13:00:06.445 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:06 smithi016 ceph-mon[27395]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:06.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:06 smithi186 ceph-mon[23420]: purged_snaps scrub starts 2024-05-06T13:00:06.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:06 smithi186 ceph-mon[23420]: purged_snaps scrub ok 2024-05-06T13:00:06.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:06 smithi186 ceph-mon[23420]: osdmap e55: 8 total, 8 up, 8 in 2024-05-06T13:00:06.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:06 smithi186 ceph-mon[23420]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:00:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":57,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","created":"2024-05-06T12:55:09.697770+0000","modified":"2024-05-06T13:00:07.333957+0000","last_up_change":"2024-05-06T13:00:04.322151+0000","last_in_change":"2024-05-06T12:59:47.487361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T12:58:13.151852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b65bb4b5-306f-4119-b718-ebf00c295292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6803","nonce":4101754006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6805","nonce":4101754006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6809","nonce":4101754006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6807","nonce":4101754006}]},"public_addr":"172.21.15.16:6803/4101754006","cluster_addr":"172.21.15.16:6805/4101754006","heartbeat_back_addr":"172.21.15.16:6809/4101754006","heartbeat_front_addr":"172.21.15.16:6807/4101754006","state":["exists","up"]},{"osd":1,"uuid":"b20ce14b-8156-4f9a-8dc4-9d4df269ea73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6811","nonce":2971640403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6813","nonce":2971640403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971640403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6815","nonce":2971640403}]},"public_addr":"172.21.15.16:6811/2971640403","cluster_addr":"172.21.15.16:6813/2971640403","heartbeat_back_addr":"172.21.15.16:6817/2971640403","heartbeat_front_addr":"172.21.15.16:6815/2971640403","state":["exists","up"]},{"osd":2,"uuid":"c7318aaf-7fb4-4d1a-becf-41f6d690dba3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6819","nonce":3605175818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6821","nonce":3605175818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6825","nonce":3605175818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6823","nonce":3605175818}]},"public_addr":"172.21.15.16:6819/3605175818","cluster_addr":"172.21.15.16:6821/3605175818","heartbeat_back_addr":"172.21.15.16:6825/3605175818","heartbeat_front_addr":"172.21.15.16:6823/3605175818","state":["exists","up"]},{"osd":3,"uuid":"6341fe44-e6d9-40ca-8e63-6b232680a41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6827","nonce":1302090119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6829","nonce":1302090119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6833","nonce":1302090119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6831","nonce":1302090119}]},"public_addr":"172.21.15.16:6827/1302090119","cluster_addr":"172.21.15.16:6829/1302090119","heartbeat_back_addr":"172.21.15.16:6833/1302090119","heartbeat_front_addr":"172.21.15.16:6831/1302090119","state":["exists","up"]},{"osd":4,"uuid":"b24312dd-6e26-445e-bb18-51bd2ca04937","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6801","nonce":3576436305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6803","nonce":3576436305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6807","nonce":3576436305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6805","nonce":3576436305}]},"public_addr":"172.21.15.186:6801/3576436305","cluster_addr":"172.21.15.186:6803/3576436305","heartbeat_back_addr":"172.21.15.186:6807/3576436305","heartbeat_front_addr":"172.21.15.186:6805/3576436305","state":["exists","up"]},{"osd":5,"uuid":"f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6809","nonce":2132738579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6811","nonce":2132738579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6815","nonce":2132738579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6813","nonce":2132738579}]},"public_addr":"172.21.15.186:6809/2132738579","cluster_addr":"172.21.15.186:6811/2132738579","heartbeat_back_addr":"172.21.15.186:6815/2132738579","heartbeat_front_addr":"172.21.15.186:6813/2132738579","state":["exists","up"]},{"osd":6,"uuid":"91229d99-e5ab-42ab-839e-ea3452c09847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6817","nonce":607270918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6819","nonce":607270918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6823","nonce":607270918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6821","nonce":607270918}]},"public_addr":"172.21.15.186:6817/607270918","cluster_addr":"172.21.15.186:6819/607270918","heartbeat_back_addr":"172.21.15.186:6823/607270918","heartbeat_front_addr":"172.21.15.186:6821/607270918","state":["exists","up"]},{"osd":7,"uuid":"2bf1d457-c776-4ef2-967f-7b8c7198e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6825","nonce":3651075563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6827","nonce":3651075563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6831","nonce":3651075563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6829","nonce":3651075563}]},"public_addr":"172.21.15.186:6825/3651075563","cluster_addr":"172.21.15.186:6827/3651075563","heartbeat_back_addr":"172.21.15.186:6831/3651075563","heartbeat_front_addr":"172.21.15.186:6829/3651075563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:57:26.009512+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:57:48.652561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:10.948055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:34.120487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:56.985725+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:59:19.584804+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:59:41.457279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:00:03.725577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:0/1674941589":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6800/957904688":"2024-05-07T12:56:02.594166+0000","172.21.15.16:0/3592322858":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6800/1535678464":"2024-05-07T12:55:40.174839+0000","172.21.15.16:6801/957904688":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6801/1535678464":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/2640820386":"2024-05-07T12:56:02.594166+0000","172.21.15.16:0/101050378":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/3583175826":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/1876005166":"2024-05-07T12:55:40.174839+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T13:00:07.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:07 smithi016 ceph-mon[22420]: osdmap e56: 8 total, 8 up, 8 in 2024-05-06T13:00:07.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:07 smithi016 ceph-mon[27395]: osdmap e56: 8 total, 8 up, 8 in 2024-05-06T13:00:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:07 smithi186 ceph-mon[23420]: osdmap e56: 8 total, 8 up, 8 in 2024-05-06T13:00:08.081 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-06T12:58:13.151852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-05-06T13:00:08.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-06T13:00:08.306 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:08 smithi186 ceph-mon[23420]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:08 smithi186 ceph-mon[23420]: osdmap e57: 8 total, 8 up, 8 in 2024-05-06T13:00:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:08 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1489076703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:08.626 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:08 smithi016 ceph-mon[22420]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:08.626 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:08 smithi016 ceph-mon[22420]: osdmap e57: 8 total, 8 up, 8 in 2024-05-06T13:00:08.626 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:08 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1489076703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:08.626 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:08 smithi016 ceph-mon[27395]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:08.627 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:08 smithi016 ceph-mon[27395]: osdmap e57: 8 total, 8 up, 8 in 2024-05-06T13:00:08.627 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:08 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1489076703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:08.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:08 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:00:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:09.441 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[27395]: osdmap e58: 8 total, 8 up, 8 in 2024-05-06T13:00:09.441 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:09.442 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi186 2024-05-06T13:00:09.442 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:09.442 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[22420]: osdmap e58: 8 total, 8 up, 8 in 2024-05-06T13:00:09.442 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:09.442 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi186 2024-05-06T13:00:09.442 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:09 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:09.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:09 smithi186 ceph-mon[23420]: osdmap e58: 8 total, 8 up, 8 in 2024-05-06T13:00:09.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:09 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:09.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:09 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi186 2024-05-06T13:00:09.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:09 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:10.116 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-05-06T13:00:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:10 smithi016 ceph-mon[27395]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:10 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1526231252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T13:00:10.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:10 smithi016 ceph-mon[22420]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:10.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:10 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1526231252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T13:00:10.733 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:10 smithi186 ceph-mon[23420]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:10.733 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:10 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1526231252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-06T13:00:10.867 INFO:tasks.cephadm:Adding prometheus.a on smithi186 2024-05-06T13:00:10.867 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch apply prometheus '1;smithi186=a' 2024-05-06T13:00:12.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:12 smithi016 ceph-mon[22420]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-06T13:00:12.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:12 smithi016 ceph-mon[27395]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-06T13:00:12.595 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:12 smithi186 ceph-mon[23420]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-06T13:00:13.268 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled prometheus update... 2024-05-06T13:00:13.876 DEBUG:teuthology.orchestra.run.smithi186:prometheus.a> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service 2024-05-06T13:00:13.878 INFO:tasks.cephadm:Adding node-exporter.a on smithi016 2024-05-06T13:00:13.878 INFO:tasks.cephadm:Adding node-exporter.b on smithi186 2024-05-06T13:00:13.878 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch apply node-exporter '2;smithi016=a;smithi186=b' 2024-05-06T13:00:14.267 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:00:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:14.479 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='client.34337 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi186=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:14.479 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: Saving service prometheus spec with placement smithi186=a;count:1 2024-05-06T13:00:14.479 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ignoring --setuser ceph since I am not root 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ignoring --setgroup ceph since I am not root 2024-05-06T13:00:14.480 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:14 smithi186 ceph-mgr[24894]: -- 172.21.15.186:0/3553670774 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b9570e0340 con 0x55b9570b9000 2024-05-06T13:00:14.635 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='client.34337 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi186=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:14.635 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: Saving service prometheus spec with placement smithi186=a;count:1 2024-05-06T13:00:14.635 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.635 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='client.34337 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi186=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: Saving service prometheus spec with placement smithi186=a;count:1 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:14.636 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setuser ceph since I am not root 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setgroup ceph since I am not root 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:14 smithi016 ceph-mgr[22652]: -- 172.21.15.16:0/59905293 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b184dfc340 con 0x55b184dd4800 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:14.501+0000 7f7c8d017000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:00:14.637 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:14.634+0000 7f7c8d017000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:00:14.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:14.495+0000 7f60f4643000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:00:14.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:14.624+0000 7f60f4643000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:00:14.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:14.721+0000 7f60f4643000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:00:14.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:14.735+0000 7f7c8d017000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:00:15.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:15 smithi186 ceph-mon[23420]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-06T13:00:15.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:15 smithi186 ceph-mon[23420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:00:15.338 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:15 smithi186 ceph-mon[23420]: mgrmap e16: y(active, since 4m), standbys: x 2024-05-06T13:00:15.339 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:15.029+0000 7f60f4643000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:00:15.339 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:15.113+0000 7f60f4643000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:00:15.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:15 smithi016 ceph-mon[22420]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:15 smithi016 ceph-mon[22420]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:15 smithi016 ceph-mon[22420]: mgrmap e16: y(active, since 4m), standbys: x 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:15 smithi016 ceph-mon[27395]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:15 smithi016 ceph-mon[27395]: from='mgr.14152 172.21.15.16:0/2225605383' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:15 smithi016 ceph-mon[27395]: mgrmap e16: y(active, since 4m), standbys: x 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:15.053+0000 7f7c8d017000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:00:15.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:15.139+0000 7f7c8d017000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:00:16.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:16.247+0000 7f60f4643000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:00:16.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:16.410+0000 7f60f4643000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:00:16.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:16.490+0000 7f60f4643000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:00:16.575 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:16.317+0000 7f7c8d017000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:00:16.575 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:16.488+0000 7f7c8d017000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:00:16.576 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:16.574+0000 7f7c8d017000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:00:17.155 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:16.899+0000 7f7c8d017000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:00:17.155 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:16.994+0000 7f7c8d017000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:00:17.155 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:17.095+0000 7f7c8d017000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:00:17.220 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:16.800+0000 7f60f4643000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:00:17.220 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:16.888+0000 7f60f4643000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:00:17.220 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:16.979+0000 7f60f4643000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:00:17.220 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:17.218+0000 7f60f4643000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:00:17.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:17.351+0000 7f7c8d017000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:00:18.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:17.652+0000 7f60f4643000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:00:18.155 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:17.821+0000 7f7c8d017000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:00:18.421 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:18.333+0000 7f7c8d017000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:00:18.511 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:18.132+0000 7f60f4643000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:00:18.512 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:18.223+0000 7f60f4643000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:00:18.512 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:18.510+0000 7f60f4643000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:00:18.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:18.434+0000 7f7c8d017000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:00:18.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:18.598+0000 7f60f4643000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:00:19.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:18.746+0000 7f7c8d017000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:00:19.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:18.842+0000 7f7c8d017000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:00:19.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:18.997+0000 7f60f4643000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:00:19.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:19.126+0000 7f60f4643000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:00:19.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:19.216+0000 7f60f4643000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:00:19.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:19.273+0000 7f7c8d017000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:00:19.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:19.418+0000 7f7c8d017000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:00:19.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:19.514+0000 7f7c8d017000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:00:19.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:19.329+0000 7f60f4643000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:00:19.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:19.416+0000 7f60f4643000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:00:19.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:19.637+0000 7f7c8d017000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:00:19.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:19.730+0000 7f7c8d017000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:00:20.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:19.954+0000 7f60f4643000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:00:20.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:20.304+0000 7f7c8d017000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:00:20.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[22420]: Standby manager daemon x restarted 2024-05-06T13:00:20.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[22420]: Standby manager daemon x started 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[27395]: Standby manager daemon x restarted 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[27395]: Standby manager daemon x started 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:00:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:00:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:20 smithi186 ceph-mon[23420]: Standby manager daemon x restarted 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:20 smithi186 ceph-mon[23420]: Standby manager daemon x started 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3928312975' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:20.313+0000 7f60f4643000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: [06/May/2024:13:00:20] ENGINE Bus STARTING 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: CherryPy Checker: 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: The Application mounted at '' has an empty config. 2024-05-06T13:00:20.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: 2024-05-06T13:00:20.767 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: [06/May/2024:13:00:20] ENGINE Serving on http://:::9283 2024-05-06T13:00:20.767 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:00:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: [06/May/2024:13:00:20] ENGINE Bus STARTED 2024-05-06T13:00:21.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:20.681+0000 7f7c8d017000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:00:21.657 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[22420]: mgrmap e17: y(active, since 4m), standbys: x 2024-05-06T13:00:21.657 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[22420]: Active manager daemon y restarted 2024-05-06T13:00:21.657 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[22420]: Activating manager daemon y 2024-05-06T13:00:21.657 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[22420]: osdmap e59: 8 total, 8 up, 8 in 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[27395]: mgrmap e17: y(active, since 4m), standbys: x 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[27395]: Active manager daemon y restarted 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[27395]: Activating manager daemon y 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:21 smithi016 ceph-mon[27395]: osdmap e59: 8 total, 8 up, 8 in 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:00:21] ENGINE Bus STARTING 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: CherryPy Checker: 2024-05-06T13:00:21.658 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: The Application mounted at '' has an empty config. 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:00:21] ENGINE Serving on http://:::9283 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:00:21] ENGINE Bus STARTED 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:21 smithi186 ceph-mon[23420]: mgrmap e17: y(active, since 4m), standbys: x 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:21 smithi186 ceph-mon[23420]: Active manager daemon y restarted 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:21 smithi186 ceph-mon[23420]: Activating manager daemon y 2024-05-06T13:00:21.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:21 smithi186 ceph-mon[23420]: osdmap e59: 8 total, 8 up, 8 in 2024-05-06T13:00:22.363 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled node-exporter update... 2024-05-06T13:00:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: mgrmap e18: y(active, starting, since 0.658837s), standbys: x 2024-05-06T13:00:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:00:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: Manager daemon y is now available 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: mgrmap e18: y(active, starting, since 0.658837s), standbys: x 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:00:22.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: Manager daemon y is now available 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.678 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]': finished 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]': finished 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:22.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]': finished 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]': finished 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:22.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:22.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: mgrmap e18: y(active, starting, since 0.658837s), standbys: x 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:00:22.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: Manager daemon y is now available 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:22.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]': finished 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]': finished 2024-05-06T13:00:22.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:22.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-06T13:00:23.007 DEBUG:teuthology.orchestra.run.smithi016:node-exporter.a> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service 2024-05-06T13:00:23.010 DEBUG:teuthology.orchestra.run.smithi186:node-exporter.b> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service 2024-05-06T13:00:23.012 INFO:tasks.cephadm:Adding alertmanager.a on smithi016 2024-05-06T13:00:23.012 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch apply alertmanager '1;smithi016=a' 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: mgrmap e19: y(active, since 1.66193s), standbys: x 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi016=a;smithi186=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: Saving service node-exporter spec with placement smithi016=a;smithi186=b;count:2 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:23.671 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:23 smithi186 ceph-mon[23420]: Deploying daemon prometheus.a on smithi186 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:00:23] ENGINE Bus STARTING 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: mgrmap e19: y(active, since 1.66193s), standbys: x 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi016=a;smithi186=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: Saving service node-exporter spec with placement smithi016=a;smithi186=b;count:2 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[22420]: Deploying daemon prometheus.a on smithi186 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: mgrmap e19: y(active, since 1.66193s), standbys: x 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi016=a;smithi186=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: Saving service node-exporter spec with placement smithi016=a;smithi186=b;count:2 2024-05-06T13:00:23.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:23.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:23 smithi016 ceph-mon[27395]: Deploying daemon prometheus.a on smithi186 2024-05-06T13:00:24.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:00:23] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:00:24.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:00:23] ENGINE Bus STARTED 2024-05-06T13:00:24.662 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:24 smithi186 ceph-mon[23420]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:24.663 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:24 smithi186 ceph-mon[23420]: mgrmap e20: y(active, since 2s), standbys: x 2024-05-06T13:00:24.663 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:24 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:24.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:24 smithi016 ceph-mon[22420]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:24.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:24 smithi016 ceph-mon[22420]: mgrmap e20: y(active, since 2s), standbys: x 2024-05-06T13:00:24.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:24 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:24.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:24 smithi016 ceph-mon[27395]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:24.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:24 smithi016 ceph-mon[27395]: mgrmap e20: y(active, since 2s), standbys: x 2024-05-06T13:00:24.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:24 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:25.319 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled alertmanager update... 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[27395]: [06/May/2024:13:00:23] ENGINE Bus STARTING 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[27395]: [06/May/2024:13:00:23] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[27395]: [06/May/2024:13:00:23] ENGINE Bus STARTED 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[22420]: [06/May/2024:13:00:23] ENGINE Bus STARTING 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[22420]: [06/May/2024:13:00:23] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[22420]: [06/May/2024:13:00:23] ENGINE Bus STARTED 2024-05-06T13:00:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:25 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:25.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:25 smithi186 ceph-mon[23420]: [06/May/2024:13:00:23] ENGINE Bus STARTING 2024-05-06T13:00:25.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:25 smithi186 ceph-mon[23420]: [06/May/2024:13:00:23] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:00:25.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:25 smithi186 ceph-mon[23420]: [06/May/2024:13:00:23] ENGINE Bus STARTED 2024-05-06T13:00:25.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:25 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:26.243 DEBUG:teuthology.orchestra.run.smithi016:alertmanager.a> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@alertmanager.a.service 2024-05-06T13:00:26.246 INFO:tasks.cephadm:Adding grafana.a on smithi186 2024-05-06T13:00:26.246 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph orch apply grafana '1;smithi186=a' 2024-05-06T13:00:26.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:26 smithi186 ceph-mon[23420]: from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi016=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:26.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:26 smithi186 ceph-mon[23420]: Saving service alertmanager spec with placement smithi016=a;count:1 2024-05-06T13:00:26.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:26 smithi186 ceph-mon[23420]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:26 smithi016 ceph-mon[22420]: from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi016=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:26 smithi016 ceph-mon[22420]: Saving service alertmanager spec with placement smithi016=a;count:1 2024-05-06T13:00:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:26 smithi016 ceph-mon[22420]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:26.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:26 smithi016 ceph-mon[27395]: from='client.34379 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi016=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:26.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:26 smithi016 ceph-mon[27395]: Saving service alertmanager spec with placement smithi016=a;count:1 2024-05-06T13:00:26.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:26 smithi016 ceph-mon[27395]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:28.388 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:28 smithi186 ceph-mon[23420]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:28.388 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:28 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:28.388 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:28 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:28 smithi016 ceph-mon[22420]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:28 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:28.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:28 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:28.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:28 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:00:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:28.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:28 smithi016 ceph-mon[27395]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:28 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:28.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:28 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:28.974 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled grafana update... 2024-05-06T13:00:29.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:29 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi186 2024-05-06T13:00:29.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:29 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:29.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:29 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi186 2024-05-06T13:00:29.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:29 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:29 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi186 2024-05-06T13:00:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:29 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:30.253 DEBUG:teuthology.orchestra.run.smithi186:grafana.a> sudo journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@grafana.a.service 2024-05-06T13:00:30.256 INFO:tasks.cephadm:Setting up client nodes... 2024-05-06T13:00:30.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-06T13:00:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:30 smithi186 ceph-mon[23420]: from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi186=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:30 smithi186 ceph-mon[23420]: Saving service grafana spec with placement smithi186=a;count:1 2024-05-06T13:00:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:30 smithi186 ceph-mon[23420]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:30.566 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:30 smithi016 ceph-mon[22420]: from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi186=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:30.566 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:30 smithi016 ceph-mon[22420]: Saving service grafana spec with placement smithi186=a;count:1 2024-05-06T13:00:30.566 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:30 smithi016 ceph-mon[22420]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:30.567 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:30 smithi016 ceph-mon[27395]: from='client.34385 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi186=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:00:30.567 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:30 smithi016 ceph-mon[27395]: Saving service grafana spec with placement smithi186=a;count:1 2024-05-06T13:00:30.567 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:30 smithi016 ceph-mon[27395]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:32.397 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-05-06T13:00:32.397 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBw1DhmRiNqFxAAYYiEmlIpywm0Vb3zC5d08w== 2024-05-06T13:00:32.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:32 smithi016 ceph-mon[22420]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:32.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:32 smithi016 ceph-mon[27395]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:32.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:32 smithi186 ceph-mon[23420]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:33.087 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-06T13:00:33.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-06T13:00:33.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-06T13:00:33.126 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-06T13:00:33.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:33 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/93552742' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:33 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:33 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:00:33.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:33 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/93552742' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:33.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:33 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:33.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:33 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:00:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:33 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/93552742' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:33 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:33 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:00:34.374 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:00:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:34 smithi016 ceph-mon[27395]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:34.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:34.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:34 smithi016 ceph-mon[22420]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:34.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:34.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:34.691 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:34 smithi186 ceph-mon[23420]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:34.692 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:34.692 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:36.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:36 smithi016 ceph-mon[22420]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:36.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:36 smithi016 ceph-mon[27395]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:36.682 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:36 smithi186 ceph-mon[23420]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:38.407 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:38 smithi016 ceph-mon[22420]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:38.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:38 smithi016 ceph-mon[27395]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:38.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:38 smithi186 ceph-mon[23420]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:38.782 INFO:teuthology.orchestra.run.smithi186.stdout:[client.1] 2024-05-06T13:00:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB21DhmhMlhLhAAVF+UXXhkPr8my4ezJvgSlQ== 2024-05-06T13:00:39.456 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:39 smithi016 ceph-mon[22420]: from='client.? 172.21.15.186:0/2555529433' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:39.456 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:39 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:39.456 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:39 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:00:39.457 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:39 smithi016 ceph-mon[27395]: from='client.? 172.21.15.186:0/2555529433' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:39.457 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:39 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:39.457 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:39 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:00:39.685 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:39 smithi186 ceph-mon[23420]: from='client.? 172.21.15.186:0/2555529433' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:39.685 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:39 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-06T13:00:39.685 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:39 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-06T13:00:39.708 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-05-06T13:00:39.708 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-06T13:00:39.708 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-06T13:00:39.748 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-06T13:00:39.748 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-06T13:00:39.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-06T13:00:39.944 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:39 smithi186 podman[39500]: 2024-05-06 13:00:39.829058781 +0000 UTC m=+0.019075940 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-06T13:00:39.944 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:39 smithi186 podman[39500]: 2024-05-06 13:00:39.944036833 +0000 UTC m=+0.134053986 container create 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:00:39.972 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:40.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:40 smithi186 ceph-mon[23420]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:40.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:40 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:40.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:40 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:40.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:40 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:40.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:40 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:40.484 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 podman[39500]: 2024-05-06 13:00:40.213520737 +0000 UTC m=+0.403537880 container init 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 podman[39500]: 2024-05-06 13:00:40.21632161 +0000 UTC m=+0.406338754 container start 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.239Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.239Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.239Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.239Z caller=main.go:518 level=info host_details="(Linux 5.14.0-437.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 x86_64 smithi186 (none))" 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.239Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.239Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.240Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.241Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.242Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.244Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-06T13:00:40.485 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.244Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.505µs 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.244Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.244Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.244Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=27.956µs wal_replay_duration=159.97µs total_replay_duration=201.752µs 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.245Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.245Z caller=main.go:947 level=info msg="TSDB started" 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.245Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.260Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.680672ms db_storage=652ns remote_storage=1.145µs web_handler=265ns query_engine=590ns scrape=424.514µs scrape_sd=16.222µs notify=698ns notify_sd=1.753µs rules=13.884464ms 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:00:40.260Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 bash[39500]: 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 2024-05-06T13:00:40.486 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:00:40 smithi186 systemd[1]: Started Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[22420]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[27395]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:40.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:40 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:41.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.186:9095"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.186:9095"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.564 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:41 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:41.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:00:41.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.186:9095"}]: dispatch 2024-05-06T13:00:41.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:41.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:41 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:42.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:00:42.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.186:9095"}]: dispatch 2024-05-06T13:00:42.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:42.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:42.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[22420]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:42.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:42.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:00:42.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.186:9095"}]: dispatch 2024-05-06T13:00:42.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:42.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:42.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[27395]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:42.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:42 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:42.422 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:00:42.713 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:42 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:00:42.713 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:42 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.186:9095"}]: dispatch 2024-05-06T13:00:42.713 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:42.713 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:00:42.714 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:42 smithi186 ceph-mon[23420]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:42.714 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:42 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:43.073 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"active_gid":14451,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1814467570},{"type":"v1","addr":"172.21.15.16:6801","nonce":1814467570}]},"active_addr":"172.21.15.16:6801/1814467570","active_change":"2024-05-06T13:00:20.684258+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":34343,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.16:8443/","prometheus":"http://172.21.15.16:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":59,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":978664437}]},{"addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":457828510}]},{"addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":3883601318}]},{"addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1751854629}]}]}} 2024-05-06T13:00:43.080 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-06T13:00:43.080 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-06T13:00:43.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T13:00:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:43.643 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:43 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1621503878' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T13:00:43.644 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:43 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1621503878' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T13:00:43.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:43 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1621503878' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-06T13:00:44.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:44 smithi016 ceph-mon[22420]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:44.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:44 smithi016 ceph-mon[27395]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:44.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:44 smithi186 ceph-mon[23420]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:45.166 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:00:45.166 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":59,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","created":"2024-05-06T12:55:09.697770+0000","modified":"2024-05-06T13:00:20.683932+0000","last_up_change":"2024-05-06T13:00:04.322151+0000","last_in_change":"2024-05-06T12:59:47.487361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T12:58:13.151852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b65bb4b5-306f-4119-b718-ebf00c295292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6803","nonce":4101754006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6805","nonce":4101754006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6809","nonce":4101754006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6807","nonce":4101754006}]},"public_addr":"172.21.15.16:6803/4101754006","cluster_addr":"172.21.15.16:6805/4101754006","heartbeat_back_addr":"172.21.15.16:6809/4101754006","heartbeat_front_addr":"172.21.15.16:6807/4101754006","state":["exists","up"]},{"osd":1,"uuid":"b20ce14b-8156-4f9a-8dc4-9d4df269ea73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6811","nonce":2971640403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6813","nonce":2971640403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971640403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6815","nonce":2971640403}]},"public_addr":"172.21.15.16:6811/2971640403","cluster_addr":"172.21.15.16:6813/2971640403","heartbeat_back_addr":"172.21.15.16:6817/2971640403","heartbeat_front_addr":"172.21.15.16:6815/2971640403","state":["exists","up"]},{"osd":2,"uuid":"c7318aaf-7fb4-4d1a-becf-41f6d690dba3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6819","nonce":3605175818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6821","nonce":3605175818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6825","nonce":3605175818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6823","nonce":3605175818}]},"public_addr":"172.21.15.16:6819/3605175818","cluster_addr":"172.21.15.16:6821/3605175818","heartbeat_back_addr":"172.21.15.16:6825/3605175818","heartbeat_front_addr":"172.21.15.16:6823/3605175818","state":["exists","up"]},{"osd":3,"uuid":"6341fe44-e6d9-40ca-8e63-6b232680a41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6827","nonce":1302090119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6829","nonce":1302090119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6833","nonce":1302090119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6831","nonce":1302090119}]},"public_addr":"172.21.15.16:6827/1302090119","cluster_addr":"172.21.15.16:6829/1302090119","heartbeat_back_addr":"172.21.15.16:6833/1302090119","heartbeat_front_addr":"172.21.15.16:6831/1302090119","state":["exists","up"]},{"osd":4,"uuid":"b24312dd-6e26-445e-bb18-51bd2ca04937","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6801","nonce":3576436305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6803","nonce":3576436305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6807","nonce":3576436305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6805","nonce":3576436305}]},"public_addr":"172.21.15.186:6801/3576436305","cluster_addr":"172.21.15.186:6803/3576436305","heartbeat_back_addr":"172.21.15.186:6807/3576436305","heartbeat_front_addr":"172.21.15.186:6805/3576436305","state":["exists","up"]},{"osd":5,"uuid":"f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6809","nonce":2132738579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6811","nonce":2132738579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6815","nonce":2132738579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6813","nonce":2132738579}]},"public_addr":"172.21.15.186:6809/2132738579","cluster_addr":"172.21.15.186:6811/2132738579","heartbeat_back_addr":"172.21.15.186:6815/2132738579","heartbeat_front_addr":"172.21.15.186:6813/2132738579","state":["exists","up"]},{"osd":6,"uuid":"91229d99-e5ab-42ab-839e-ea3452c09847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6817","nonce":607270918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6819","nonce":607270918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6823","nonce":607270918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6821","nonce":607270918}]},"public_addr":"172.21.15.186:6817/607270918","cluster_addr":"172.21.15.186:6819/607270918","heartbeat_back_addr":"172.21.15.186:6823/607270918","heartbeat_front_addr":"172.21.15.186:6821/607270918","state":["exists","up"]},{"osd":7,"uuid":"2bf1d457-c776-4ef2-967f-7b8c7198e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6825","nonce":3651075563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6827","nonce":3651075563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6831","nonce":3651075563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6829","nonce":3651075563}]},"public_addr":"172.21.15.186:6825/3651075563","cluster_addr":"172.21.15.186:6827/3651075563","heartbeat_back_addr":"172.21.15.186:6831/3651075563","heartbeat_front_addr":"172.21.15.186:6829/3651075563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:57:26.009512+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:57:48.652561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:10.948055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:34.120487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:56.985725+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:59:19.584804+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:59:41.457279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:00:03.725577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:0/3572509176":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/3953946814":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/3596258180":"2024-05-07T13:00:20.683895+0000","172.21.15.16:6801/1703766038":"2024-05-07T13:00:20.683895+0000","172.21.15.16:6800/1703766038":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/1674941589":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6800/957904688":"2024-05-07T12:56:02.594166+0000","172.21.15.16:0/3592322858":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6800/1535678464":"2024-05-07T12:55:40.174839+0000","172.21.15.16:6801/957904688":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6801/1535678464":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/1546528134":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/2640820386":"2024-05-07T12:56:02.594166+0000","172.21.15.16:0/101050378":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/3583175826":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/1876005166":"2024-05-07T12:55:40.174839+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T13:00:45.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:45 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1446676573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:45.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:45 smithi016 ceph-mon[22420]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:45.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:45 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1446676573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:45.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:45 smithi016 ceph-mon[27395]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:45.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:45 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1446676573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:45 smithi186 ceph-mon[23420]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:45.854 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:00:45] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:45.879 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-06T13:00:45.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-06T13:00:46.096 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:46.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:46 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:46.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:46 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:46.821 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:00:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:46.821 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:46 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:00:47.937 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":59,"fsid":"c6d11770-0ba7-11ef-bc97-c7b262605968","created":"2024-05-06T12:55:09.697770+0000","modified":"2024-05-06T13:00:20.683932+0000","last_up_change":"2024-05-06T13:00:04.322151+0000","last_in_change":"2024-05-06T12:59:47.487361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T12:58:13.151852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b65bb4b5-306f-4119-b718-ebf00c295292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6803","nonce":4101754006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6805","nonce":4101754006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6809","nonce":4101754006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4101754006},{"type":"v1","addr":"172.21.15.16:6807","nonce":4101754006}]},"public_addr":"172.21.15.16:6803/4101754006","cluster_addr":"172.21.15.16:6805/4101754006","heartbeat_back_addr":"172.21.15.16:6809/4101754006","heartbeat_front_addr":"172.21.15.16:6807/4101754006","state":["exists","up"]},{"osd":1,"uuid":"b20ce14b-8156-4f9a-8dc4-9d4df269ea73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6811","nonce":2971640403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6813","nonce":2971640403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6817","nonce":2971640403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2971640403},{"type":"v1","addr":"172.21.15.16:6815","nonce":2971640403}]},"public_addr":"172.21.15.16:6811/2971640403","cluster_addr":"172.21.15.16:6813/2971640403","heartbeat_back_addr":"172.21.15.16:6817/2971640403","heartbeat_front_addr":"172.21.15.16:6815/2971640403","state":["exists","up"]},{"osd":2,"uuid":"c7318aaf-7fb4-4d1a-becf-41f6d690dba3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6819","nonce":3605175818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6821","nonce":3605175818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6825","nonce":3605175818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3605175818},{"type":"v1","addr":"172.21.15.16:6823","nonce":3605175818}]},"public_addr":"172.21.15.16:6819/3605175818","cluster_addr":"172.21.15.16:6821/3605175818","heartbeat_back_addr":"172.21.15.16:6825/3605175818","heartbeat_front_addr":"172.21.15.16:6823/3605175818","state":["exists","up"]},{"osd":3,"uuid":"6341fe44-e6d9-40ca-8e63-6b232680a41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6827","nonce":1302090119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6829","nonce":1302090119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6833","nonce":1302090119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":1302090119},{"type":"v1","addr":"172.21.15.16:6831","nonce":1302090119}]},"public_addr":"172.21.15.16:6827/1302090119","cluster_addr":"172.21.15.16:6829/1302090119","heartbeat_back_addr":"172.21.15.16:6833/1302090119","heartbeat_front_addr":"172.21.15.16:6831/1302090119","state":["exists","up"]},{"osd":4,"uuid":"b24312dd-6e26-445e-bb18-51bd2ca04937","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6801","nonce":3576436305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6803","nonce":3576436305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6807","nonce":3576436305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":3576436305},{"type":"v1","addr":"172.21.15.186:6805","nonce":3576436305}]},"public_addr":"172.21.15.186:6801/3576436305","cluster_addr":"172.21.15.186:6803/3576436305","heartbeat_back_addr":"172.21.15.186:6807/3576436305","heartbeat_front_addr":"172.21.15.186:6805/3576436305","state":["exists","up"]},{"osd":5,"uuid":"f2f9786b-b9b9-4b51-a0af-9c68bbf9ce85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6809","nonce":2132738579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6811","nonce":2132738579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6815","nonce":2132738579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2132738579},{"type":"v1","addr":"172.21.15.186:6813","nonce":2132738579}]},"public_addr":"172.21.15.186:6809/2132738579","cluster_addr":"172.21.15.186:6811/2132738579","heartbeat_back_addr":"172.21.15.186:6815/2132738579","heartbeat_front_addr":"172.21.15.186:6813/2132738579","state":["exists","up"]},{"osd":6,"uuid":"91229d99-e5ab-42ab-839e-ea3452c09847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6817","nonce":607270918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6819","nonce":607270918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6823","nonce":607270918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":607270918},{"type":"v1","addr":"172.21.15.186:6821","nonce":607270918}]},"public_addr":"172.21.15.186:6817/607270918","cluster_addr":"172.21.15.186:6819/607270918","heartbeat_back_addr":"172.21.15.186:6823/607270918","heartbeat_front_addr":"172.21.15.186:6821/607270918","state":["exists","up"]},{"osd":7,"uuid":"2bf1d457-c776-4ef2-967f-7b8c7198e7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6825","nonce":3651075563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6827","nonce":3651075563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6831","nonce":3651075563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3651075563},{"type":"v1","addr":"172.21.15.186:6829","nonce":3651075563}]},"public_addr":"172.21.15.186:6825/3651075563","cluster_addr":"172.21.15.186:6827/3651075563","heartbeat_back_addr":"172.21.15.186:6831/3651075563","heartbeat_front_addr":"172.21.15.186:6829/3651075563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:57:26.009512+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:57:48.652561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:10.948055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:34.120487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:58:56.985725+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:59:19.584804+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T12:59:41.457279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T13:00:03.725577+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:0/3572509176":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/3953946814":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/3596258180":"2024-05-07T13:00:20.683895+0000","172.21.15.16:6801/1703766038":"2024-05-07T13:00:20.683895+0000","172.21.15.16:6800/1703766038":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/1674941589":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6800/957904688":"2024-05-07T12:56:02.594166+0000","172.21.15.16:0/3592322858":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6800/1535678464":"2024-05-07T12:55:40.174839+0000","172.21.15.16:6801/957904688":"2024-05-07T12:56:02.594166+0000","172.21.15.16:6801/1535678464":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/1546528134":"2024-05-07T13:00:20.683895+0000","172.21.15.16:0/2640820386":"2024-05-07T12:56:02.594166+0000","172.21.15.16:0/101050378":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/3583175826":"2024-05-07T12:55:40.174839+0000","172.21.15.16:0/1876005166":"2024-05-07T12:55:40.174839+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T13:00:48.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: Deploying daemon node-exporter.a on smithi016 2024-05-06T13:00:48.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:47 smithi186 ceph-mon[23420]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:48.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: Deploying daemon node-exporter.a on smithi016 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[22420]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:00:48.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:00:48.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:00:48.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:48.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: Deploying daemon node-exporter.a on smithi016 2024-05-06T13:00:48.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:47 smithi016 ceph-mon[27395]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:48.624 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-06T13:00:48.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-06T13:00:48.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-06T13:00:48.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-06T13:00:48.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-06T13:00:48.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-06T13:00:48.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-06T13:00:48.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-06T13:00:48.804 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:48 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1121736660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:48.804 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:48 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1121736660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:49.038 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.098 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.102 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.105 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.112 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:49 smithi016 bash[43626]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-05-06T13:00:49.112 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.114 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.116 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:00:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:48 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1121736660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-06T13:00:50.645 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:50 smithi016 ceph-mon[27395]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:50.645 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:50 smithi016 ceph-mon[22420]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:50 smithi186 ceph-mon[23420]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:50.924 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:50 smithi016 bash[43626]: Getting image source signatures 2024-05-06T13:00:50.924 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:50 smithi016 bash[43626]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-05-06T13:00:50.924 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:50 smithi016 bash[43626]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-05-06T13:00:50.924 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:50 smithi016 bash[43626]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-05-06T13:00:51.701 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:51 smithi016 ceph-mon[22420]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:51.701 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:51 smithi016 ceph-mon[27395]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:51 smithi186 ceph-mon[23420]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:53.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:53 smithi016 ceph-mon[22420]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:53.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:53 smithi016 ceph-mon[27395]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:53 smithi186 ceph-mon[23420]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:54.121 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:53 smithi016 bash[43626]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-05-06T13:00:54.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:00:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:00:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:00:54.424 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:54 smithi016 bash[43626]: Writing manifest to image destination 2024-05-06T13:00:55.149 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:54 smithi016 podman[43626]: 2024-05-06 13:00:54.839566993 +0000 UTC m=+5.962849016 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-06T13:00:55.149 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 podman[43626]: 2024-05-06 13:00:55.021568122 +0000 UTC m=+6.144850145 container create ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:00:55.476 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:55.476 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:55.590 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:55.591 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:55.591 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:55.591 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:55.591 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 podman[43626]: 2024-05-06 13:00:55.273824762 +0000 UTC m=+6.397106786 container init ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 podman[43626]: 2024-05-06 13:00:55.278766042 +0000 UTC m=+6.402048066 container start ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.285Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.285Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.286Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=arp 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-06T13:00:55.592 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=edac 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-06T13:00:55.593 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=os 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-06T13:00:55.594 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=stat 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=time 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=uname 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.287Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.288Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[44125]: ts=2024-05-06T13:00:55.288Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-06T13:00:55.595 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 bash[43626]: ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee 2024-05-06T13:00:55.596 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:00:55 smithi016 systemd[1]: Started Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:00:56.307 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:56 smithi186 ceph-mon[23420]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:56.307 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:56 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:56.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:56 smithi016 ceph-mon[22420]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:56.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:56 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:56.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:56 smithi016 ceph-mon[27395]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:56.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:56 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:00:56.765 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:56 smithi186 bash[40310]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-05-06T13:00:57.207 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:56 smithi186 bash[40310]: Getting image source signatures 2024-05-06T13:00:57.207 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:56 smithi186 bash[40310]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-05-06T13:00:57.207 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:56 smithi186 bash[40310]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-05-06T13:00:57.207 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:56 smithi186 bash[40310]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-05-06T13:00:57.337 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:57 smithi016 ceph-mon[22420]: Deploying daemon node-exporter.b on smithi186 2024-05-06T13:00:57.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:57 smithi016 ceph-mon[27395]: Deploying daemon node-exporter.b on smithi186 2024-05-06T13:00:57.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:57 smithi186 ceph-mon[23420]: Deploying daemon node-exporter.b on smithi186 2024-05-06T13:00:58.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:00:58 smithi016 ceph-mon[22420]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:58.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:00:58 smithi016 ceph-mon[27395]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:00:58 smithi186 ceph-mon[23420]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:00:58.554 INFO:teuthology.orchestra.run.smithi016.stdout:128849018905 2024-05-06T13:00:58.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-06T13:00:59.933 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:59 smithi186 bash[40310]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-05-06T13:00:59.933 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:00:59 smithi186 bash[40310]: Writing manifest to image destination 2024-05-06T13:00:59.962 INFO:teuthology.orchestra.run.smithi016.stdout:231928233995 2024-05-06T13:00:59.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-06T13:01:00.560 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:00 smithi016 ceph-mon[22420]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:00.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:00 smithi016 ceph-mon[27395]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:00.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:00 smithi186 ceph-mon[23420]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:00.694 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:00 smithi186 podman[40310]: 2024-05-06 13:01:00.440884296 +0000 UTC m=+4.229722122 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-06T13:01:01.022 INFO:teuthology.orchestra.run.smithi016.stdout:107374182430 2024-05-06T13:01:01.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:00 smithi186 podman[40310]: 2024-05-06 13:01:00.983365926 +0000 UTC m=+4.772203778 container create e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 podman[40310]: 2024-05-06 13:01:01.168953793 +0000 UTC m=+4.957791605 container init e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 podman[40310]: 2024-05-06 13:01:01.171954802 +0000 UTC m=+4.960792612 container start e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.176Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.176Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.176Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-06T13:01:01.266 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.176Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=arp 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=edac 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-06T13:01:01.267 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-06T13:01:01.268 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=os 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=stat 2024-05-06T13:01:01.269 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=time 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=uname 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.177Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.178Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-06T13:01:01.270 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[40396]: ts=2024-05-06T13:01:01.178Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-06T13:01:01.608 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 bash[40310]: e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea 2024-05-06T13:01:01.608 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:01:01 smithi186 systemd[1]: Started Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:01:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:163208757270 2024-05-06T13:01:01.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-06T13:01:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[22420]: Deploying daemon alertmanager.a on smithi016 2024-05-06T13:01:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[22420]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:02.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:02.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[27395]: Deploying daemon alertmanager.a on smithi016 2024-05-06T13:01:02.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[27395]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:02.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:02 smithi186 ceph-mon[23420]: Deploying daemon alertmanager.a on smithi016 2024-05-06T13:01:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:02 smithi186 ceph-mon[23420]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:03.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:03 smithi186 ceph-mon[23420]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:03.784 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:03 smithi016 ceph-mon[22420]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:03.785 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:03 smithi016 ceph-mon[27395]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:04.083 INFO:teuthology.orchestra.run.smithi016.stdout:197568495634 2024-05-06T13:01:04.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-06T13:01:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:05.017 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:05.705 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:05 smithi186 ceph-mon[23420]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:05.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:05 smithi016 ceph-mon[22420]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:05.830 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:05 smithi016 ceph-mon[27395]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:06.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:01:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:07.550 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:01:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:07 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:07 smithi186 ceph-mon[23420]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:07 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:07 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[27395]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[22420]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:07.854 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:07 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:09.121 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:10.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:10 smithi016 ceph-mon[22420]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:10 smithi016 ceph-mon[27395]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:10 smithi186 ceph-mon[23420]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:11.039 INFO:teuthology.orchestra.run.smithi016.stdout:34359738414 2024-05-06T13:01:11.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-06T13:01:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:11 smithi186 ceph-mon[23420]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:11.872 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:11 smithi016 ceph-mon[22420]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:11.872 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:11 smithi016 ceph-mon[27395]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:13.077 INFO:teuthology.orchestra.run.smithi016.stdout:77309411366 2024-05-06T13:01:13.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-06T13:01:13.592 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:13 smithi016 ceph-mon[22420]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:13.592 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:13 smithi016 ceph-mon[27395]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:13 smithi186 ceph-mon[23420]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:14.275 INFO:teuthology.orchestra.run.smithi016.stdout:55834574890 2024-05-06T13:01:14.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-06T13:01:14.658 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:15.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:15.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:16.592 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:16 smithi016 ceph-mon[22420]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:16.592 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:16 smithi016 ceph-mon[27395]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:16.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:16 smithi186 ceph-mon[23420]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:17.263 INFO:teuthology.orchestra.run.smithi016.stdout:128849018909 2024-05-06T13:01:17.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:17 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/19748861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T13:01:17.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:17 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/19748861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T13:01:17.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:17 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/19748861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-06T13:01:17.995 INFO:teuthology.orchestra.run.smithi016.stdout:231928233998 2024-05-06T13:01:18.348 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018905 got 128849018909 for osd.4 2024-05-06T13:01:18.349 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:18.642 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:18 smithi016 ceph-mon[22420]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:18.642 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:18 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/535270934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-06T13:01:18.643 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:18 smithi016 ceph-mon[27395]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:18.643 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:18 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/535270934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-06T13:01:18.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:18 smithi186 ceph-mon[23420]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:18.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:18 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/535270934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-06T13:01:19.502 INFO:teuthology.orchestra.run.smithi016.stdout:163208757274 2024-05-06T13:01:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:20.381 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:20.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:20 smithi016 ceph-mon[22420]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:20.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:20 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3191458919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T13:01:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:20 smithi016 ceph-mon[27395]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:20 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3191458919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T13:01:20.754 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928233995 got 231928233998 for osd.7 2024-05-06T13:01:20.754 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:20 smithi186 ceph-mon[23420]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:20 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3191458919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-06T13:01:21.150 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757270 got 163208757274 for osd.5 2024-05-06T13:01:21.150 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:21.176 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:21.732 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[22420]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[27395]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:01:21.733 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:21 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:01:21.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:21 smithi186 ceph-mon[23420]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:21.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:21 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:01:21.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:21 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:01:21.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:21 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:01:21.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:21 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:01:21.839 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:23.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:23 smithi186 ceph-mon[23420]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:23.789 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:23 smithi016 ceph-mon[22420]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:23.790 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:23 smithi016 ceph-mon[27395]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:24.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:01:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:25.909 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:25 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:25.909 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:25 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:25.909 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:25 smithi186 ceph-mon[23420]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:26.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:25 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:26.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:25 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:26.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:25 smithi016 ceph-mon[22420]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:26.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:25 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:26.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:25 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:26.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:25 smithi016 ceph-mon[27395]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:27.299 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:27 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[46110]: level=info ts=2024-05-06T13:01:27.248Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-05-06T13:01:27.299 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:27 smithi016 bash[46068]: 15f8f0aa811739d7eeba66bafa0625244ff5700580b8675307d01d0b78911b95 2024-05-06T13:01:27.310 INFO:teuthology.orchestra.run.smithi016.stdout:107374182436 2024-05-06T13:01:27.554 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:27 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1018453497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T13:01:27.554 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:27 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1018453497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T13:01:27.555 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:27 smithi016 systemd[1]: Started Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:01:27.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:27 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1018453497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-06T13:01:28.232 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182430 got 107374182436 for osd.3 2024-05-06T13:01:28.232 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:28.536 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[22420]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:28.536 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[27395]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:01:28.537 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:28 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:197568495640 2024-05-06T13:01:28.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:28 smithi186 ceph-mon[23420]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:28.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:28 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:28 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:28 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:28.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:28 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:01:28.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:28 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:29.416 INFO:teuthology.orchestra.run.smithi016.stdout:55834574894 2024-05-06T13:01:29.539 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:29 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:01:29.539 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:29 smithi016 ceph-mon[22420]: Deploying daemon grafana.a on smithi186 2024-05-06T13:01:29.539 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:29 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3495393672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-06T13:01:29.540 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:29 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:01:29.540 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:29 smithi016 ceph-mon[27395]: Deploying daemon grafana.a on smithi186 2024-05-06T13:01:29.540 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:29 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3495393672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-06T13:01:29.540 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:29 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[46110]: level=info ts=2024-05-06T13:01:29.215Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000361503s 2024-05-06T13:01:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:29 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:01:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:29 smithi186 ceph-mon[23420]: Deploying daemon grafana.a on smithi186 2024-05-06T13:01:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:29 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3495393672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-06T13:01:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:30 smithi016 ceph-mon[22420]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:30 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3700407670' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T13:01:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:30 smithi016 ceph-mon[27395]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:30 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3700407670' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T13:01:30.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:30 smithi186 ceph-mon[23420]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:30.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:30 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3700407670' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-06T13:01:31.140 INFO:teuthology.orchestra.run.smithi016.stdout:34359738419 2024-05-06T13:01:31.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:31 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/477420313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T13:01:31.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:31 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/477420313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T13:01:31.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:31 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/477420313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-06T13:01:31.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738414 got 34359738419 for osd.0 2024-05-06T13:01:31.885 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:32.487 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574890 got 55834574894 for osd.1 2024-05-06T13:01:32.487 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:32.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:32 smithi016 ceph-mon[22420]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:32.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:32 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:32.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:32 smithi016 ceph-mon[27395]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:32.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:32 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:32.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:32 smithi186 ceph-mon[23420]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:32.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:32 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:33.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495634 got 197568495640 for osd.6 2024-05-06T13:01:33.801 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:34.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:34 smithi016 ceph-mon[22420]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:34.405 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:34 smithi016 ceph-mon[27395]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:34.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:34.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:34 smithi186 ceph-mon[23420]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:35.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:35 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:35.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:35 smithi016 ceph-mon[22420]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:35.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:35 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:35.573 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:35 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:35.573 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:35 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:35.573 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:35 smithi016 ceph-mon[27395]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:35.573 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:35 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:35 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:35 smithi186 ceph-mon[23420]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:35 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:36.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:36.360 INFO:teuthology.orchestra.run.smithi016.stdout:77309411371 2024-05-06T13:01:36.919 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411366 got 77309411371 for osd.2 2024-05-06T13:01:36.919 DEBUG:teuthology.parallel:result is None 2024-05-06T13:01:36.920 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-06T13:01:36.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-06T13:01:37.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:37 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:37.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:37 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1144665688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T13:01:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:37 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:37 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1144665688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T13:01:37.439 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:37 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[46110]: level=info ts=2024-05-06T13:01:37.218Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003075681s 2024-05-06T13:01:37.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:37 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:37.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:37 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1144665688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-06T13:01:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:38.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:38 smithi016 ceph-mon[22420]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:38.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:38 smithi016 ceph-mon[27395]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:38.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:38 smithi186 ceph-mon[23420]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:39.505 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:01:39.507 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-06T13:01:40.096 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-06T13:01:39.361676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48840,"kb_used_data":6088,"kb_used_omap":0,"kb_used_meta":42688,"kb_avail":749912376,"statfs":{"total":767960285184,"available":767910273024,"internally_reserved":0,"allocated":6234112,"data_stored":3488336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43712512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002126"},"pg_stats":[{"pgid":"1.0","version":"59'128","reported_seq":267,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-06T13:00:21.439711+0000","last_change":"2024-05-06T13:00:08.343182+0000","last_active":"2024-05-06T13:00:21.439711+0000","last_peered":"2024-05-06T13:00:21.439711+0000","last_clean":"2024-05-06T13:00:21.439711+0000","last_became_active":"2024-05-06T13:00:08.342676+0000","last_became_peered":"2024-05-06T13:00:08.342676+0000","last_unstale":"2024-05-06T13:00:21.439711+0000","last_undegraded":"2024-05-06T13:00:21.439711+0000","last_fullsized":"2024-05-06T13:00:21.439711+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T12:58:13.461348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T12:58:13.461348+0000","last_clean_scrub_stamp":"2024-05-06T12:58:13.461348+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T23:26:56.543899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6088,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739064,"statfs":{"total":95995035648,"available":95988801536,"internally_reserved":0,"allocated":1114112,"data_stored":766769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.503},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.376}]},{"osd":6,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.39700000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495642,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6148,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739004,"statfs":{"total":95995035648,"available":95988740096,"internally_reserved":0,"allocated":1110016,"data_stored":766446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.49199999999999999}]},{"osd":4,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.36199999999999999}]},{"osd":5,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.31}]},{"osd":7,"last update":"Mon May 6 13:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6336,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738816,"statfs":{"total":95995035648,"available":95988547584,"internally_reserved":0,"allocated":581632,"data_stored":237841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.39600000000000002,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":3.5619999999999998,"5min":3.5619999999999998,"15min":3.5619999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.748,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon May 6 13:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.45500000000000002,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon May 6 13:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.38100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.28999999999999998}]},{"osd":4,"last update":"Mon May 6 13:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.64200000000000002,"15min":0.627},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.9950000000000001,"5min":3.9950000000000001,"15min":3.9950000000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon May 6 13:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Mon May 6 13:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon May 6 13:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.0279999999999996,"5min":4.0279999999999996,"15min":4.0279999999999996},"last":0.51900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6920,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738232,"statfs":{"total":95995035648,"available":95987949568,"internally_reserved":0,"allocated":1114112,"data_stored":766769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 6 13:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32400000000000001}]},{"osd":2,"last update":"Mon May 6 13:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36399999999999999}]},{"osd":3,"last update":"Mon May 6 13:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.36199999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon May 6 13:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon May 6 13:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.65800000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.622}]},{"osd":6,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon May 6 13:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.497}]}]},{"osd":2,"up_from":18,"seq":77309411372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6272,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738880,"statfs":{"total":95995035648,"available":95988613120,"internally_reserved":0,"allocated":581632,"data_stored":237841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55500000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52000000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Mon May 6 13:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.436},"min":{"1min":0.318,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36499999999999999}]},{"osd":3,"last update":"Mon May 6 13:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38400000000000001}]},{"osd":4,"last update":"Mon May 6 13:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":0.624},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon May 6 13:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86699999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80200000000000005,"5min":0.875,"15min":0.875},"last":0.65400000000000003}]},{"osd":6,"last update":"Mon May 6 13:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.625},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59999999999999998}]},{"osd":7,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58899999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5692,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739460,"statfs":{"total":95995035648,"available":95989207040,"internally_reserved":0,"allocated":577536,"data_stored":237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42699999999999999,"15min":0.42899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60599999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.22600000000000001}]},{"osd":1,"last update":"Mon May 6 13:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.622,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.439,"15min":0.44},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.28899999999999998}]},{"osd":2,"last update":"Mon May 6 13:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.62,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.255}]},{"osd":4,"last update":"Mon May 6 13:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76400000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70299999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39200000000000002}]},{"osd":5,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.371},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.378}]},{"osd":6,"last update":"Mon May 6 13:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.41499999999999998}]},{"osd":7,"last update":"Mon May 6 13:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.45200000000000001}]}]},{"osd":4,"up_from":30,"seq":128849018914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5760,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739392,"statfs":{"total":95995035648,"available":95989137408,"internally_reserved":0,"allocated":581632,"data_stored":237841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49299999999999999}]},{"osd":2,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.69199999999999995}]},{"osd":5,"last update":"Mon May 6 13:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.38300000000000001},"min":{"1min":0.312,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.39100000000000001}]},{"osd":6,"last update":"Mon May 6 13:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.44}]},{"osd":7,"last update":"Mon May 6 13:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.621}]}]},{"osd":5,"up_from":38,"seq":163208757278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739528,"statfs":{"total":95995035648,"available":95989276672,"internally_reserved":0,"allocated":573440,"data_stored":237253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65600000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.49299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69199999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67800000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.62}]},{"osd":4,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.435,"15min":0.42699999999999999},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.432}]},{"osd":6,"last update":"Mon May 6 13:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.44600000000000001}]},{"osd":7,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T13:01:40.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-06T13:01:40.336 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:40.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:40 smithi016 ceph-mon[22420]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:40 smithi016 ceph-mon[27395]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:40.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:40 smithi186 ceph-mon[23420]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:41.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:41 smithi016 ceph-mon[22420]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:01:41.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:41 smithi016 ceph-mon[27395]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:01:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:41 smithi186 ceph-mon[23420]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:01:42.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:42 smithi016 ceph-mon[22420]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:42.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:42.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:42 smithi016 ceph-mon[27395]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:42 smithi186 ceph-mon[23420]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:01:43.585 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-06T13:01:43.666 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:43 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:43 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:43 smithi186 ceph-mon[23420]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:43.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:43 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:43.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:43 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:43.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:43 smithi016 ceph-mon[22420]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:43 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:43 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:43 smithi016 ceph-mon[27395]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:44.676 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-06T13:01:43.362324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48840,"kb_used_data":6088,"kb_used_omap":0,"kb_used_meta":42688,"kb_avail":749912376,"statfs":{"total":767960285184,"available":767910273024,"internally_reserved":0,"allocated":6234112,"data_stored":3488336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43712512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002193"},"pg_stats":[{"pgid":"1.0","version":"59'128","reported_seq":267,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-06T13:00:21.439711+0000","last_change":"2024-05-06T13:00:08.343182+0000","last_active":"2024-05-06T13:00:21.439711+0000","last_peered":"2024-05-06T13:00:21.439711+0000","last_clean":"2024-05-06T13:00:21.439711+0000","last_became_active":"2024-05-06T13:00:08.342676+0000","last_became_peered":"2024-05-06T13:00:08.342676+0000","last_unstale":"2024-05-06T13:00:21.439711+0000","last_undegraded":"2024-05-06T13:00:21.439711+0000","last_fullsized":"2024-05-06T13:00:21.439711+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T12:58:13.461348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T12:58:13.461348+0000","last_clean_scrub_stamp":"2024-05-06T12:58:13.461348+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T23:26:56.543899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6088,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739064,"statfs":{"total":95995035648,"available":95988801536,"internally_reserved":0,"allocated":1114112,"data_stored":766769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57899999999999996}]},{"osd":3,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.307},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.34499999999999997}]},{"osd":5,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.36099999999999999}]},{"osd":6,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.377}]}]},{"osd":6,"up_from":46,"seq":197568495643,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6148,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739004,"statfs":{"total":95995035648,"available":95988740096,"internally_reserved":0,"allocated":1110016,"data_stored":766446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41399999999999998}]},{"osd":1,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.374},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.496}]},{"osd":3,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.35399999999999998}]},{"osd":5,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.436}]},{"osd":7,"last update":"Mon May 6 13:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.48199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6336,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738816,"statfs":{"total":95995035648,"available":95988547584,"internally_reserved":0,"allocated":581632,"data_stored":237841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.39600000000000002,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.22,"15min":0.22},"max":{"1min":3.5619999999999998,"5min":3.5619999999999998,"15min":3.5619999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.748,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon May 6 13:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.45500000000000002,"15min":0.41599999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon May 6 13:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.38100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.28999999999999998}]},{"osd":4,"last update":"Mon May 6 13:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.64200000000000002,"15min":0.627},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.9950000000000001,"5min":3.9950000000000001,"15min":3.9950000000000001},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon May 6 13:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Mon May 6 13:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon May 6 13:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.0279999999999996,"5min":4.0279999999999996,"15min":4.0279999999999996},"last":0.51900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6920,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738232,"statfs":{"total":95995035648,"available":95987949568,"internally_reserved":0,"allocated":1114112,"data_stored":766769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 6 13:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.254},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.28100000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon May 6 13:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.39300000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.41199999999999998,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon May 6 13:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.36199999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64300000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Mon May 6 13:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44}]},{"osd":5,"last update":"Mon May 6 13:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.65800000000000003,"15min":0.66300000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon May 6 13:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.41399999999999998}]},{"osd":7,"last update":"Mon May 6 13:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6272,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738880,"statfs":{"total":95995035648,"available":95988613120,"internally_reserved":0,"allocated":581632,"data_stored":237841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55500000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.316},{"interface":"front","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52000000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Mon May 6 13:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41099999999999998,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73399999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.436},"min":{"1min":0.318,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon May 6 13:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]},{"osd":4,"last update":"Mon May 6 13:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":0.624},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.437}]},{"osd":5,"last update":"Mon May 6 13:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68100000000000005,"15min":0.69199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86699999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80200000000000005,"5min":0.875,"15min":0.875},"last":0.44400000000000001}]},{"osd":6,"last update":"Mon May 6 13:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.50700000000000001}]},{"osd":7,"last update":"Mon May 6 13:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52300000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182440,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5692,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739460,"statfs":{"total":95995035648,"available":95989207040,"internally_reserved":0,"allocated":577536,"data_stored":237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42199999999999999,"15min":0.42799999999999999},"min":{"1min":0.249,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.65700000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42899999999999999,"15min":0.44500000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.41399999999999998}]},{"osd":1,"last update":"Mon May 6 13:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.435,"15min":0.439},"min":{"1min":0.28899999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57099999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon May 6 13:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.317,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.72899999999999998}]},{"osd":4,"last update":"Mon May 6 13:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76400000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70299999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.746}]},{"osd":5,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.622},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon May 6 13:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.66500000000000004}]},{"osd":7,"last update":"Mon May 6 13:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996}]}]},{"osd":4,"up_from":30,"seq":128849018915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5760,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739392,"statfs":{"total":95995035648,"available":95989137408,"internally_reserved":0,"allocated":581632,"data_stored":237841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.39300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.751,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.70999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":5,"last update":"Mon May 6 13:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39300000000000002,"15min":0.38300000000000001},"min":{"1min":0.312,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38500000000000001}]},{"osd":6,"last update":"Mon May 6 13:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.372},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.35199999999999998}]},{"osd":7,"last update":"Mon May 6 13:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.432}]}]},{"osd":5,"up_from":38,"seq":163208757279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739528,"statfs":{"total":95995035648,"available":95989276672,"internally_reserved":0,"allocated":573440,"data_stored":237253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65600000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45900000000000002}]},{"osd":1,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.49299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69199999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67800000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon May 6 13:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.40300000000000002,"15min":0.39100000000000001},"min":{"1min":0.32400000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.435,"15min":0.42699999999999999},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.35699999999999998}]},{"osd":6,"last update":"Mon May 6 13:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.316}]},{"osd":7,"last update":"Mon May 6 13:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T13:01:44.677 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-06T13:01:44.677 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-06T13:01:44.677 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-06T13:01:44.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-06T13:01:44.918 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:01:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:45.118 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/mon.a/config 2024-05-06T13:01:45.475 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:45 smithi186 ceph-mon[23420]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:01:45.475 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:45 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:45.475 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:45 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:45.576 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:45 smithi016 ceph-mon[22420]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:01:45.577 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:45 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:45.577 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:45 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:45.577 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:45 smithi016 ceph-mon[27395]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-06T13:01:45.577 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:45 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:45.577 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:45 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:46.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:46 smithi186 ceph-mon[23420]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:46.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:46 smithi016 ceph-mon[22420]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:46.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:46 smithi016 ceph-mon[27395]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:47.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:47 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:47.587 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-06T13:01:47.587 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-06T13:01:48.016 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:47 smithi186 systemd[1]: Starting Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:01:48.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:48.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:48.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[22420]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:48.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2247679310' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T13:01:48.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:48.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:48.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[27395]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:48.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:48 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2247679310' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T13:01:48.186 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-06T13:01:48.186 INFO:tasks.cephadm:Setup complete, yielding 2024-05-06T13:01:48.187 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T13:01:48.198 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-05-06T13:01:48.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-05-06T13:01:48.323 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:48 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:48.323 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:48 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:48.323 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:48 smithi186 ceph-mon[23420]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:48.323 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:48 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2247679310' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-06T13:01:48.324 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 podman[41701]: 2024-05-06 13:01:47.975037854 +0000 UTC m=+0.017448198 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-05-06T13:01:48.324 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 podman[41701]: 2024-05-06 13:01:48.081879466 +0000 UTC m=+0.124289850 container create e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, vendor=Red Hat, Inc., maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, build-date=2022-03-28T10:36:18.413762, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, description=Ceph Grafana Container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, release=236.1648460182, io.openshift.expose-services=, name=ubi8, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, vcs-type=git, version=8.5) 2024-05-06T13:01:48.324 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 podman[41701]: 2024-05-06 13:01:48.276250864 +0000 UTC m=+0.318661198 container init e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, release=236.1648460182, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, io.openshift.expose-services=, build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, description=Ceph Grafana Container, name=ubi8, architecture=x86_64, vcs-type=git, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182) 2024-05-06T13:01:48.324 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 podman[41701]: 2024-05-06 13:01:48.278726787 +0000 UTC m=+0.321137122 container start e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, build-date=2022-03-28T10:36:18.413762, architecture=x86_64, name=ubi8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, release=236.1648460182, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., description=Ceph Grafana Container, io.buildah.version=1.24.2, io.openshift.tags=base rhel8, com.redhat.component=ubi8-container) 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-05-06T13:01:48.325 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="App mode production" logger=settings 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-05-06T13:01:48.326 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-05-06T13:01:48.327 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-05-06T13:01:48.576 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-05-06T13:01:48.576 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-05-06T13:01:48.576 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-05-06T13:01:48.576 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-05-06T13:01:48.576 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-05-06T13:01:48.576 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-05-06T13:01:48.577 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-05-06T13:01:48.578 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 bash[41701]: e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 systemd[1]: Started Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-05-06T13:01:48.579 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-05-06T13:01:48.580 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-05-06T13:01:48.581 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-05-06T13:01:48.582 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-05-06T13:01:48.583 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-05-06T13:01:48.583 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-05-06T13:01:48.583 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-05-06T13:01:48.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-05-06T13:01:48.585 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-05-06T13:01:48.585 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-05-06T13:01:48.585 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-05-06T13:01:48.585 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-05-06T13:01:48.585 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-05-06T13:01:48.585 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-05-06T13:01:48.586 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-05-06T13:01:48.587 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-05-06T13:01:48.588 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-05-06T13:01:48.589 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-05-06T13:01:48.590 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-05-06T13:01:48.591 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-05-06T13:01:48.592 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-05-06T13:01:48.592 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-05-06T13:01:48.592 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-05-06T13:01:48.592 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-05-06T13:01:48.592 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-05-06T13:01:48.592 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-05-06T13:01:48.593 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-05-06T13:01:48.594 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-05-06T13:01:48.594 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-05-06T13:01:48.594 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-05-06T13:01:48.594 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-05-06T13:01:48.826 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-05-06T13:01:48.826 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-05-06T13:01:48.826 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-05-06T13:01:48.826 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-05-06T13:01:48.827 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-05-06T13:01:48.828 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-05-06T13:01:48.829 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-05-06T13:01:48.830 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-05-06T13:01:48.830 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-05-06T13:01:48.830 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-05-06T13:01:48.831 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-05-06T13:01:48.831 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-05-06T13:01:48.831 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-05-06T13:01:48.831 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-05-06T13:01:48.831 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-05-06T13:01:48.831 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-05-06T13:01:48.832 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-05-06T13:01:48.833 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-05-06T13:01:48.834 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-05-06T13:01:48.834 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-05-06T13:01:48.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-05-06T13:01:48.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-05-06T13:01:48.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-05-06T13:01:48.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-05-06T13:01:48.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-05-06T13:01:48.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-05-06T13:01:48.837 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-05-06T13:01:48.838 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-05-06T13:01:48.839 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-05-06T13:01:48.840 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-05-06T13:01:48.841 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-05-06T13:01:48.842 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-05-06T13:01:48.843 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-05-06T13:01:49.266 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-05-06T13:01:49.267 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-05-06T13:01:49.268 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-05-06T13:01:49.269 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-05-06T13:01:49.270 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-05-06T13:01:49.271 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=604.364674ms 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:48+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:49+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:49+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:49+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:49+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-05-06T13:01:49.272 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:01:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:01:49+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-05-06T13:01:49.472 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: Reconfiguring daemon alertmanager.a on smithi016 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[22420]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:01:49.473 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:01:49.474 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:49.474 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:01:49.474 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-06T13:01:49.474 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: Reconfiguring daemon alertmanager.a on smithi016 2024-05-06T13:01:49.474 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:49 smithi016 ceph-mon[27395]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: Reconfiguring daemon alertmanager.a on smithi016 2024-05-06T13:01:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:49 smithi186 ceph-mon[23420]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:51.630 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:51 smithi016 ceph-mon[22420]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:51.631 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:51 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:51.631 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:51 smithi016 ceph-mon[27395]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:51.631 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:51 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:51.751 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:51 smithi186 ceph-mon[23420]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:51.751 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:51 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:52.821 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:52 smithi016 systemd[1]: Stopping Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:01:53.158 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:01:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:53.181 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T13:01:53.191 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-05-06T13:01:53.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-05-06T13:01:53.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:01:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:53 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1478727158' entity='client.admin' 2024-05-06T13:01:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:53 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:53 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:53.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:53 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1478727158' entity='client.admin' 2024-05-06T13:01:53.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:53 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:53.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:53 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:53.425 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:53 smithi016 bash[48200]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager.a" found: no such container 2024-05-06T13:01:53.425 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[46110]: level=info ts=2024-05-06T13:01:53.345Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:01:53.425 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:53 smithi016 podman[48296]: 2024-05-06 13:01:53.366002985 +0000 UTC m=+0.127162162 container died 15f8f0aa811739d7eeba66bafa0625244ff5700580b8675307d01d0b78911b95 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:01:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:53 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1478727158' entity='client.admin' 2024-05-06T13:01:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:53 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:53 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:54.166 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:53 smithi016 podman[48296]: 2024-05-06 13:01:53.846270565 +0000 UTC m=+0.607429731 container cleanup 15f8f0aa811739d7eeba66bafa0625244ff5700580b8675307d01d0b78911b95 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:01:54.166 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:53 smithi016 bash[48296]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a 2024-05-06T13:01:54.166 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:53 smithi016 bash[48345]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager.a" found: no such container 2024-05-06T13:01:54.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:54 smithi016 ceph-mon[22420]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:54.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:54.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:54 smithi016 ceph-mon[22420]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:01:54.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:54 smithi016 ceph-mon[27395]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:54.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:54.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:54 smithi016 ceph-mon[27395]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:01:54.614 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:54 smithi186 ceph-mon[23420]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:54.614 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:54.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:54 smithi186 ceph-mon[23420]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:01:55.164 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:01:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:01:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:01:55.942 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:55 smithi016 podman[48324]: 2024-05-06 13:01:55.683530647 +0000 UTC m=+2.317464205 container remove 15f8f0aa811739d7eeba66bafa0625244ff5700580b8675307d01d0b78911b95 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:01:55.942 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:55 smithi016 podman[48324]: 2024-05-06 13:01:55.776061422 +0000 UTC m=+2.409994982 volume remove c9389cd37113325dd33b317a775fa33fbbf099546c57b87db00671754caa8078 2024-05-06T13:01:55.942 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:55 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-06T13:01:55.942 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:55 smithi016 systemd[1]: Stopped Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:01:55.942 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:55 smithi016 systemd[1]: Starting Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:01:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:55 smithi186 ceph-mon[23420]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:55 smithi186 ceph-mon[23420]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:56.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:56.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:56.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[22420]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:56.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[22420]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:56.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:56.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:56.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[27395]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:56.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[27395]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:56.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:57.257 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:56 smithi016 podman[48495]: 2024-05-06 13:01:56.95960263 +0000 UTC m=+0.283259329 volume create ec0ab944e163f3be0b19ae3ea0eca0e2802068253d968213d6e37d849d03ba56 2024-05-06T13:01:57.257 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:56 smithi016 podman[48495]: 2024-05-06 13:01:56.87597441 +0000 UTC m=+0.199631137 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-05-06T13:01:57.257 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 podman[48495]: 2024-05-06 13:01:57.051640287 +0000 UTC m=+0.375296986 container create 948f7a58173a622e987ce7a62900149d2aa6f35083e5e7690b3ad3a27da5f35c (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:01:57.666 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 podman[48495]: 2024-05-06 13:01:57.363208816 +0000 UTC m=+0.686865516 container init 948f7a58173a622e987ce7a62900149d2aa6f35083e5e7690b3ad3a27da5f35c (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:01:57.666 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 podman[48495]: 2024-05-06 13:01:57.365939982 +0000 UTC m=+0.689596687 container start 948f7a58173a622e987ce7a62900149d2aa6f35083e5e7690b3ad3a27da5f35c (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.376Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.376Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.377Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.16 port=9094 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.378Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.404Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.405Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.407Z caller=main.go:518 msg=Listening address=:9093 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:57.407Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 bash[48495]: 948f7a58173a622e987ce7a62900149d2aa6f35083e5e7690b3ad3a27da5f35c 2024-05-06T13:01:57.667 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:57 smithi016 systemd[1]: Started Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:01:58.341 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:01:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "d6dfde78-a4d4-4ded-aabe-2043c5ed5595", 2024-05-06T13:01:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "r", 2024-05-06T13:01:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "current_period": "03cc4212-d4d3-43e0-8ea4-350fd990e3b8", 2024-05-06T13:01:58.341 INFO:teuthology.orchestra.run.smithi016.stdout: "epoch": 1 2024-05-06T13:01:58.341 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:01:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:58 smithi186 ceph-mon[23420]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:58 smithi186 ceph-mon[23420]: osdmap e60: 8 total, 8 up, 8 in 2024-05-06T13:01:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:58 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/774798202' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-06T13:01:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:58 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[22420]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[22420]: osdmap e60: 8 total, 8 up, 8 in 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/774798202' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[27395]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[27395]: osdmap e60: 8 total, 8 up, 8 in 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/774798202' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-06T13:01:58.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:58 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:01:59.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-05-06T13:01:59.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[22420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[22420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/774798202' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[22420]: osdmap e61: 8 total, 8 up, 8 in 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[27395]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[27395]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/774798202' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-06T13:01:59.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:01:59 smithi016 ceph-mon[27395]: osdmap e61: 8 total, 8 up, 8 in 2024-05-06T13:01:59.479 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:59 smithi186 ceph-mon[23420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:01:59.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:59 smithi186 ceph-mon[23420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:01:59.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:59 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/774798202' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-06T13:01:59.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:01:59 smithi186 ceph-mon[23420]: osdmap e61: 8 total, 8 up, 8 in 2024-05-06T13:01:59.633 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:01:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:01:59.379Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000794075s 2024-05-06T13:02:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:00 smithi186 ceph-mon[23420]: pgmap v55: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:00 smithi186 ceph-mon[23420]: osdmap e62: 8 total, 8 up, 8 in 2024-05-06T13:02:00.517 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 systemd[1]: Stopping Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:02:00.517 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 bash[42598]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:02:00.659 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:00 smithi016 ceph-mon[22420]: pgmap v55: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:00.659 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:00 smithi016 ceph-mon[22420]: osdmap e62: 8 total, 8 up, 8 in 2024-05-06T13:02:00.660 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:00 smithi016 ceph-mon[27395]: pgmap v55: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:00.660 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:00 smithi016 ceph-mon[27395]: osdmap e62: 8 total, 8 up, 8 in 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-06T13:02:00.839 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-06T13:02:00.840 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.521Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-06T13:02:00.840 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.522Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-06T13:02:00.840 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.522Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-06T13:02:00.840 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[39515]: ts=2024-05-06T13:02:00.522Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-06T13:02:00.840 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 podman[42611]: 2024-05-06 13:02:00.531339191 +0000 UTC m=+0.117791439 container died 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "1af7f7d0-d620-4bce-870b-6e7b1c800102", 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default", 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout: "api_name": "default", 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout: "is_master": "true", 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout: "endpoints": [], 2024-05-06T13:02:00.968 INFO:teuthology.orchestra.run.smithi016.stdout: "hostnames": [], 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "hostnames_s3website": [], 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "master_zone": "", 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "zones": [], 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_targets": [], 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "realm_id": "d6dfde78-a4d4-4ded-aabe-2043c5ed5595", 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "sync_policy": { 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: "groups": [] 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:00.969 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:02:01.189 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 podman[42611]: 2024-05-06 13:02:00.930187773 +0000 UTC m=+0.516640029 container cleanup 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:02:01.189 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 bash[42611]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a 2024-05-06T13:02:01.190 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:00 smithi186 bash[42639]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:02:01.441 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 podman[42625]: 2024-05-06 13:02:01.189883825 +0000 UTC m=+0.655418957 container remove 6735de77cb77dd00a064355a22059136f33cb16b2be64629fc7e29d40b0963f9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:02:01.441 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-06T13:02:01.441 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 systemd[1]: Stopped Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:02:01.441 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 systemd[1]: Starting Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:02:01.441 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 podman[42708]: 2024-05-06 13:02:01.333049838 +0000 UTC m=+0.020538100 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-06T13:02:01.441 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 podman[42708]: 2024-05-06 13:02:01.441337649 +0000 UTC m=+0.128825897 container create 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:02:01.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-05-06T13:02:01.711 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 podman[42708]: 2024-05-06 13:02:01.685855881 +0000 UTC m=+0.373344129 container init 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:02:01.711 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 podman[42708]: 2024-05-06 13:02:01.688538938 +0000 UTC m=+0.376027186 container start 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.711Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.711Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.711Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.711Z caller=main.go:518 level=info host_details="(Linux 5.14.0-437.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 x86_64 smithi186 (none))" 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.711Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.711Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.713Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.714Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.715Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.717Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.717Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.685µs 2024-05-06T13:02:02.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.717Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.719Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.719Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.719Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=36.585µs wal_replay_duration=1.668691ms total_replay_duration=1.725196ms 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.720Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.720Z caller=main.go:947 level=info msg="TSDB started" 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.720Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.735Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.581405ms db_storage=677ns remote_storage=1.51µs web_handler=291ns query_engine=603ns scrape=471.172µs scrape_sd=21.309µs notify=19.525µs notify_sd=7.891µs rules=14.712938ms 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:02:01.735Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 bash[42708]: 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 2024-05-06T13:02:02.017 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:02:01 smithi186 systemd[1]: Started Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: pgmap v57: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.16:9093"}]: dispatch 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:02:02.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.186:3000"}]: dispatch 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: pgmap v57: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.16:9093"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.186:3000"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:02.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:02 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: pgmap v57: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.16:9093"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.186:3000"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:02.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:02.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:02 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:03.358 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:02:03.358 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "c8fe79f0-5452-4a41-9200-f2c7720e4517", 2024-05-06T13:02:03.358 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "z", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "domain_root": "z.rgw.meta:root", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "control_pool": "z.rgw.control", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "gc_pool": "z.rgw.log:gc", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "lc_pool": "z.rgw.log:lc", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "log_pool": "z.rgw.log", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "roles_pool": "z.rgw.meta:roles", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "otp_pool": "z.rgw.otp", 2024-05-06T13:02:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: "system_key": { 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "", 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "" 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_pools": [ 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "default-placement", 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "val": { 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "index_pool": "z.rgw.buckets.index", 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_classes": { 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "STANDARD": { 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "data_pool": "z.rgw.buckets.data" 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:03.360 INFO:teuthology.orchestra.run.smithi016.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout: "index_type": 0 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout: "realm_id": "d6dfde78-a4d4-4ded-aabe-2043c5ed5595", 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout: "notif_pool": "z.rgw.log:notif" 2024-05-06T13:02:03.361 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:02:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.16:9093"}]: dispatch 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.186:3000"}]: dispatch 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: pgmap v58: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:02:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:03 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.16:9093"}]: dispatch 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.186:3000"}]: dispatch 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: pgmap v58: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:02:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.16:9093"}]: dispatch 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.186:3000"}]: dispatch 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: pgmap v58: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:02:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:03 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T13:02:04.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-05-06T13:02:05.613 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:05 smithi016 ceph-mon[22420]: pgmap v59: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 626 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-06T13:02:05.614 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:05 smithi016 ceph-mon[27395]: pgmap v59: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 626 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-06T13:02:05.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:05 smithi186 ceph-mon[23420]: pgmap v59: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 626 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-06T13:02:07.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:07 smithi016 ceph-mon[22420]: pgmap v60: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 543 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-06T13:02:07.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:07 smithi016 ceph-mon[22420]: osdmap e63: 8 total, 8 up, 8 in 2024-05-06T13:02:07.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:07 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-06T13:02:07.675 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:02:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:02:07.381Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002982877s 2024-05-06T13:02:07.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:07 smithi016 ceph-mon[27395]: pgmap v60: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 543 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-06T13:02:07.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:07 smithi016 ceph-mon[27395]: osdmap e63: 8 total, 8 up, 8 in 2024-05-06T13:02:07.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:07 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-06T13:02:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:07 smithi186 ceph-mon[23420]: pgmap v60: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 543 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-05-06T13:02:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:07 smithi186 ceph-mon[23420]: osdmap e63: 8 total, 8 up, 8 in 2024-05-06T13:02:07.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:07 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-06T13:02:07.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:02:07 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:07] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:02:08.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:08 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-05-06T13:02:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:08 smithi016 ceph-mon[22420]: osdmap e64: 8 total, 8 up, 8 in 2024-05-06T13:02:08.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:08 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-05-06T13:02:08.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:08 smithi016 ceph-mon[27395]: osdmap e64: 8 total, 8 up, 8 in 2024-05-06T13:02:08.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:08 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-05-06T13:02:08.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:08 smithi186 ceph-mon[23420]: osdmap e64: 8 total, 8 up, 8 in 2024-05-06T13:02:09.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:09 smithi016 ceph-mon[22420]: pgmap v63: 65 pgs: 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-05-06T13:02:09.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:09 smithi016 ceph-mon[22420]: osdmap e65: 8 total, 8 up, 8 in 2024-05-06T13:02:09.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:09 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-06T13:02:09.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:09 smithi016 ceph-mon[27395]: pgmap v63: 65 pgs: 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-05-06T13:02:09.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:09 smithi016 ceph-mon[27395]: osdmap e65: 8 total, 8 up, 8 in 2024-05-06T13:02:09.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:09 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-06T13:02:09.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:09 smithi186 ceph-mon[23420]: pgmap v63: 65 pgs: 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-05-06T13:02:09.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:09 smithi186 ceph-mon[23420]: osdmap e65: 8 total, 8 up, 8 in 2024-05-06T13:02:09.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:09 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[27395]: osdmap e66: 8 total, 8 up, 8 in 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[27395]: osdmap e67: 8 total, 8 up, 8 in 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[22420]: osdmap e66: 8 total, 8 up, 8 in 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[22420]: osdmap e67: 8 total, 8 up, 8 in 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-06T13:02:10.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:10 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-06T13:02:10.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:10 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2297992985' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-05-06T13:02:10.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:10 smithi186 ceph-mon[23420]: osdmap e66: 8 total, 8 up, 8 in 2024-05-06T13:02:10.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:10 smithi186 ceph-mon[23420]: osdmap e67: 8 total, 8 up, 8 in 2024-05-06T13:02:10.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:10 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-06T13:02:10.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:10 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[22420]: pgmap v66: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[22420]: osdmap e68: 8 total, 8 up, 8 in 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[27395]: pgmap v66: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-06T13:02:11.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-05-06T13:02:11.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[27395]: osdmap e68: 8 total, 8 up, 8 in 2024-05-06T13:02:11.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-06T13:02:11.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:11 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-06T13:02:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:11 smithi186 ceph-mon[23420]: pgmap v66: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-06T13:02:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:11 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-05-06T13:02:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:11 smithi186 ceph-mon[23420]: osdmap e68: 8 total, 8 up, 8 in 2024-05-06T13:02:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:11 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-06T13:02:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:11 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-06T13:02:13.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:12] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:13.443 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:02:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "cb3ccf31-62b3-4a95-b89a-73adbf81eeec", 2024-05-06T13:02:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "epoch": 1, 2024-05-06T13:02:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "predecessor_uuid": "03cc4212-d4d3-43e0-8ea4-350fd990e3b8", 2024-05-06T13:02:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "sync_status": [], 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "period_map": { 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "cb3ccf31-62b3-4a95-b89a-73adbf81eeec", 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "zonegroups": [ 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "1af7f7d0-d620-4bce-870b-6e7b1c800102", 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default", 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "api_name": "default", 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "is_master": "true", 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "endpoints": [], 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "hostnames": [], 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "hostnames_s3website": [], 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "master_zone": "c8fe79f0-5452-4a41-9200-f2c7720e4517", 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "zones": [ 2024-05-06T13:02:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "c8fe79f0-5452-4a41-9200-f2c7720e4517", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "z", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "endpoints": [], 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "log_meta": "false", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "log_data": "false", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_index_max_shards": 11, 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "read_only": "false", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tier_type": "", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "sync_from_all": "true", 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "sync_from": [], 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "redirect_zone": "" 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_targets": [ 2024-05-06T13:02:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "default-placement", 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "storage_classes": [ 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "STANDARD" 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "default-placement", 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "realm_id": "d6dfde78-a4d4-4ded-aabe-2043c5ed5595", 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "sync_policy": { 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "groups": [] 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "short_zone_ids": [ 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "c8fe79f0-5452-4a41-9200-f2c7720e4517", 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 946299040 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "master_zonegroup": "1af7f7d0-d620-4bce-870b-6e7b1c800102", 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "master_zone": "c8fe79f0-5452-4a41-9200-f2c7720e4517", 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "period_config": { 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-05-06T13:02:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "user_ratelimit": { 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_read_ops": 0, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_write_ops": 0, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_read_bytes": 0, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "max_write_bytes": 0, 2024-05-06T13:02:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_ratelimit": { 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_read_ops": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_write_ops": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_read_bytes": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_write_bytes": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "anonymous_ratelimit": { 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_read_ops": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_write_ops": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_read_bytes": 0, 2024-05-06T13:02:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "max_write_bytes": 0, 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "realm_id": "d6dfde78-a4d4-4ded-aabe-2043c5ed5595", 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "realm_name": "r", 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "realm_epoch": 2 2024-05-06T13:02:13.450 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:02:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: pgmap v69: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-06T13:02:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: osdmap e69: 8 total, 8 up, 8 in 2024-05-06T13:02:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-06T13:02:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-06T13:02:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: pgmap v69: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: osdmap e69: 8 total, 8 up, 8 in 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:13.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:13 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: pgmap v69: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-06T13:02:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: osdmap e69: 8 total, 8 up, 8 in 2024-05-06T13:02:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2400523636' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-06T13:02:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-06T13:02:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:13 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:14.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-05-06T13:02:14.549 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:14 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-05-06T13:02:14.549 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:14 smithi016 ceph-mon[22420]: osdmap e70: 8 total, 8 up, 8 in 2024-05-06T13:02:14.549 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:14 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-05-06T13:02:14.549 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:14 smithi016 ceph-mon[27395]: osdmap e70: 8 total, 8 up, 8 in 2024-05-06T13:02:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:14 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-05-06T13:02:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:14 smithi186 ceph-mon[23420]: osdmap e70: 8 total, 8 up, 8 in 2024-05-06T13:02:14.851 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:14] "GET /metrics HTTP/1.1" 200 194052 "" "Prometheus/2.33.4" 2024-05-06T13:02:15.393 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:02:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:15 smithi016 ceph-mon[22420]: pgmap v72: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-05-06T13:02:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:15 smithi016 ceph-mon[27395]: pgmap v72: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-05-06T13:02:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:15.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:15 smithi186 ceph-mon[23420]: pgmap v72: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-05-06T13:02:15.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:15.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:17.652 INFO:teuthology.orchestra.run.smithi016.stdout:Scheduled rgw.foo update... 2024-05-06T13:02:17.653 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:17 smithi016 ceph-mon[22420]: pgmap v73: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 187 B/s rd, 374 B/s wr, 1 op/s 2024-05-06T13:02:17.653 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:17 smithi016 ceph-mon[27395]: pgmap v73: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 187 B/s rd, 374 B/s wr, 1 op/s 2024-05-06T13:02:17.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:17 smithi186 ceph-mon[23420]: pgmap v73: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 187 B/s rd, 374 B/s wr, 1 op/s 2024-05-06T13:02:17.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:02:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:17] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: Saving service rgw.foo spec with placement count:2 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: Saving service rgw.foo spec with placement count:2 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:18.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: Deploying daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[27395]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: Saving service rgw.foo spec with placement count:2 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:18.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: Saving service rgw.foo spec with placement count:2 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: Deploying daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:02:18.906 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:18 smithi016 ceph-mon[22420]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-05-06T13:02:18.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:18.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: Saving service rgw.foo spec with placement count:2 2024-05-06T13:02:18.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:18.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:18.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: Saving service rgw.foo spec with placement count:2 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: Deploying daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:02:18.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:18 smithi186 ceph-mon[23420]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-05-06T13:02:19.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch apply rgw smpl' 2024-05-06T13:02:20.711 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:02:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:21.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:21 smithi016 ceph-mon[22420]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-05-06T13:02:21.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:21 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:21.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:21 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:21.571 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:21 smithi016 ceph-mon[27395]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-05-06T13:02:21.571 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:21 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:21.571 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:21 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:21 smithi186 ceph-mon[23420]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-05-06T13:02:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:21 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:21 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:22.267 INFO:teuthology.orchestra.run.smithi016.stdout:Scheduled rgw.smpl update... 2024-05-06T13:02:22.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:02:22.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:02:22.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:02:22.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:02:22.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:22.581 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2024-05-06T13:02:22.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.583 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:02:22.583 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:02:22.583 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:02:22.583 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:02:22.583 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-05-06T13:02:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:02:22.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:22.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph osd pool create foo' 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 757 B/s rd, 757 B/s wr, 1 op/s 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: Saving service rgw.smpl spec with placement count:2 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]': finished 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-05-06T13:02:23.560 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: osdmap e71: 8 total, 8 up, 8 in 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 757 B/s rd, 757 B/s wr, 1 op/s 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: Saving service rgw.smpl spec with placement count:2 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-05-06T13:02:23.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]': finished 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: osdmap e71: 8 total, 8 up, 8 in 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:23.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:23 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:23.693 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 757 B/s rd, 757 B/s wr, 1 op/s 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: Saving service rgw.smpl spec with placement count:2 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]': finished 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: osdmap e71: 8 total, 8 up, 8 in 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:23.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:23.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:23.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:23 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:24 smithi016 ceph-mon[22420]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:02:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:24 smithi016 ceph-mon[22420]: osdmap e72: 8 total, 8 up, 8 in 2024-05-06T13:02:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:24 smithi016 ceph-mon[27395]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:02:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:24 smithi016 ceph-mon[27395]: osdmap e72: 8 total, 8 up, 8 in 2024-05-06T13:02:24.738 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:24 smithi186 ceph-mon[23420]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:02:24.738 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:24 smithi186 ceph-mon[23420]: osdmap e72: 8 total, 8 up, 8 in 2024-05-06T13:02:24.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:24] "GET /metrics HTTP/1.1" 200 196755 "" "Prometheus/2.33.4" 2024-05-06T13:02:25.435 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'foo' created 2024-05-06T13:02:25.635 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:25 smithi186 ceph-mon[23420]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 895 B/s wr, 2 op/s 2024-05-06T13:02:25.636 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:25 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1274340553' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-06T13:02:25.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:25 smithi016 ceph-mon[27395]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 895 B/s wr, 2 op/s 2024-05-06T13:02:25.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:25 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1274340553' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-06T13:02:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:25 smithi016 ceph-mon[22420]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 895 B/s wr, 2 op/s 2024-05-06T13:02:25.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:25 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1274340553' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-06T13:02:26.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'rbd pool init foo' 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: osdmap e73: 8 total, 8 up, 8 in 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: osdmap e73: 8 total, 8 up, 8 in 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:26.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:26 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-06T13:02:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-05-06T13:02:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: osdmap e73: 8 total, 8 up, 8 in 2024-05-06T13:02:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:26 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:27.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:27.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: pgmap v81: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:27.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:27.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:27.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:27.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: osdmap e74: 8 total, 8 up, 8 in 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: pgmap v81: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:27.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: osdmap e74: 8 total, 8 up, 8 in 2024-05-06T13:02:27.666 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:27 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:27.694 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:02:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:27] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:02:27.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:27.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: pgmap v81: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:02:27.694 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:27.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:27.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:27.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:27.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: osdmap e74: 8 total, 8 up, 8 in 2024-05-06T13:02:27.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:27 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:28.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:28 smithi016 ceph-mon[22420]: osdmap e75: 8 total, 8 up, 8 in 2024-05-06T13:02:28.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:28 smithi016 ceph-mon[22420]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 265 KiB/s rd, 8.0 KiB/s wr, 491 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:28.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:28 smithi016 ceph-mon[27395]: osdmap e75: 8 total, 8 up, 8 in 2024-05-06T13:02:28.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:28 smithi016 ceph-mon[27395]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 265 KiB/s rd, 8.0 KiB/s wr, 491 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:28.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:28 smithi186 ceph-mon[23420]: osdmap e75: 8 total, 8 up, 8 in 2024-05-06T13:02:28.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:28 smithi186 ceph-mon[23420]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 265 KiB/s rd, 8.0 KiB/s wr, 491 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:30 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/646061150' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-06T13:02:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:30 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-06T13:02:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:30 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/646061150' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-06T13:02:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:30 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-06T13:02:30.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:30 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:02:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:30 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/646061150' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-06T13:02:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:30 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-06T13:02:31.142 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:30 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:31.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[27395]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 198 KiB/s rd, 6.0 KiB/s wr, 366 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:31.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[27395]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[27395]: osdmap e76: 8 total, 8 up, 8 in 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[22420]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 198 KiB/s rd, 6.0 KiB/s wr, 366 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[22420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[22420]: osdmap e76: 8 total, 8 up, 8 in 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:31 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:31.640 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:31 smithi186 ceph-mon[23420]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 198 KiB/s rd, 6.0 KiB/s wr, 366 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:31.640 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:31 smithi186 ceph-mon[23420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-05-06T13:02:31.640 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:31 smithi186 ceph-mon[23420]: osdmap e76: 8 total, 8 up, 8 in 2024-05-06T13:02:31.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:31 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:31.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:31 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:32.652 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:32 smithi016 ceph-mon[22420]: osdmap e77: 8 total, 8 up, 8 in 2024-05-06T13:02:32.652 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:32 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:02:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:32.653 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:32 smithi016 ceph-mon[27395]: osdmap e77: 8 total, 8 up, 8 in 2024-05-06T13:02:32.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:32 smithi186 ceph-mon[23420]: osdmap e77: 8 total, 8 up, 8 in 2024-05-06T13:02:32.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch apply iscsi foo u p' 2024-05-06T13:02:33.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[22420]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 219 KiB/s rd, 6.6 KiB/s wr, 406 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:33.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[22420]: osdmap e78: 8 total, 8 up, 8 in 2024-05-06T13:02:33.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:33.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:33.581 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[27395]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 219 KiB/s rd, 6.6 KiB/s wr, 406 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:33.581 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[27395]: osdmap e78: 8 total, 8 up, 8 in 2024-05-06T13:02:33.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:33.582 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:33 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:33 smithi186 ceph-mon[23420]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 219 KiB/s rd, 6.6 KiB/s wr, 406 op/s; 0 B/s, 0 objects/s recovering 2024-05-06T13:02:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:33 smithi186 ceph-mon[23420]: osdmap e78: 8 total, 8 up, 8 in 2024-05-06T13:02:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:33 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:33 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:33] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:34.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:34] "GET /metrics HTTP/1.1" 200 196755 "" "Prometheus/2.33.4" 2024-05-06T13:02:34.989 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: Saving service rgw.smpl spec with placement count:2 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:34.990 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[22420]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: Saving service rgw.smpl spec with placement count:2 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:34.992 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:34.992 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:34 smithi016 ceph-mon[27395]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:02:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T13:02:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: Saving service rgw.smpl spec with placement count:2 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:34 smithi186 ceph-mon[23420]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:02:35.417 INFO:teuthology.orchestra.run.smithi016.stdout:Scheduled iscsi.foo update... 2024-05-06T13:02:36.114 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'sleep 120' 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[22420]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[22420]: Saving service iscsi.foo spec with placement count:1 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[22420]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[27395]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[27395]: Saving service iscsi.foo spec with placement count:1 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:36.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:36 smithi016 ceph-mon[27395]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T13:02:36.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:36 smithi186 ceph-mon[23420]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:02:36.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:36 smithi186 ceph-mon[23420]: Saving service iscsi.foo spec with placement count:1 2024-05-06T13:02:36.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:36 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:36.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:36 smithi186 ceph-mon[23420]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 60 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-05-06T13:02:37.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:02:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:37] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:02:39.152 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:38 smithi186 ceph-mon[23420]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 273 B/s wr, 0 op/s 2024-05-06T13:02:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:38 smithi016 ceph-mon[22420]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 273 B/s wr, 0 op/s 2024-05-06T13:02:39.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:38 smithi016 ceph-mon[27395]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 273 B/s wr, 0 op/s 2024-05-06T13:02:40.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:02:40.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:40 smithi186 ceph-mon[23420]: osdmap e79: 8 total, 8 up, 8 in 2024-05-06T13:02:40.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[27395]: osdmap e79: 8 total, 8 up, 8 in 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:40.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:40.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:02:40.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-06T13:02:40.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:40.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:40.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:02:40.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:40 smithi016 ceph-mon[22420]: osdmap e79: 8 total, 8 up, 8 in 2024-05-06T13:02:41.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:41 smithi016 ceph-mon[22420]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T13:02:41.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:41 smithi016 ceph-mon[27395]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T13:02:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:41 smithi186 ceph-mon[23420]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:42.469 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:42.470 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:42 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:42.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:42.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:42.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:42 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:43.663 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[22420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[22420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[22420]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 108 B/s wr, 0 op/s 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[27395]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[27395]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:43.664 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:43 smithi016 ceph-mon[27395]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 108 B/s wr, 0 op/s 2024-05-06T13:02:43.686 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:43 smithi186 ceph-mon[23420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:43.686 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:43.686 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:43 smithi186 ceph-mon[23420]: Checking dashboard <-> RGW credentials 2024-05-06T13:02:43.686 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:43.687 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:43 smithi186 ceph-mon[23420]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 61 MiB used, 715 GiB / 715 GiB avail; 108 B/s wr, 0 op/s 2024-05-06T13:02:44.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:44] "GET /metrics HTTP/1.1" 200 207972 "" "Prometheus/2.33.4" 2024-05-06T13:02:45.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:45.659 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:45 smithi016 ceph-mon[22420]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-05-06T13:02:45.660 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:45 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:45.660 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:45 smithi016 ceph-mon[27395]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-05-06T13:02:45.660 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:45 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:45 smithi186 ceph-mon[23420]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-05-06T13:02:45.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:45 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:45.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:02:45] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:47.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[22420]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[27395]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:46 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.230 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:46 smithi186 ceph-mon[23420]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 307 B/s wr, 208 op/s 2024-05-06T13:02:47.230 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:46 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.230 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:46 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.230 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:46 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:47.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:02:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:47] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:02:48.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:02:48] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 204 B/s wr, 207 op/s 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: Checking pool "foo" exists for service iscsi.foo 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[22420]: Deploying daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 204 B/s wr, 207 op/s 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: Checking pool "foo" exists for service iscsi.foo 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:49 smithi016 ceph-mon[27395]: Deploying daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:02:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 204 B/s wr, 207 op/s 2024-05-06T13:02:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: Checking pool "foo" exists for service iscsi.foo 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:49.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:49 smithi186 ceph-mon[23420]: Deploying daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:02:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:50 smithi016 ceph-mon[22420]: mgrmap e21: y(active, since 2m), standbys: x 2024-05-06T13:02:50.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:50 smithi016 ceph-mon[27395]: mgrmap e21: y(active, since 2m), standbys: x 2024-05-06T13:02:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:50 smithi186 ceph-mon[23420]: mgrmap e21: y(active, since 2m), standbys: x 2024-05-06T13:02:51.643 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:51 smithi016 ceph-mon[22420]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 130 KiB/s rd, 195 B/s wr, 198 op/s 2024-05-06T13:02:51.643 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:51 smithi016 ceph-mon[27395]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 130 KiB/s rd, 195 B/s wr, 198 op/s 2024-05-06T13:02:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:51 smithi186 ceph-mon[23420]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 130 KiB/s rd, 195 B/s wr, 198 op/s 2024-05-06T13:02:52.577 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.577 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: Adding iSCSI gateway http://:@172.21.15.16:5000 to Dashboard 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi016"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi016"}]: dispatch 2024-05-06T13:02:52.578 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 170 B/s wr, 173 op/s 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4059025260' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4134797261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:52.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: Adding iSCSI gateway http://:@172.21.15.16:5000 to Dashboard 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi016"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi016"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:52.580 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:52.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 170 B/s wr, 173 op/s 2024-05-06T13:02:52.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4059025260' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:02:52.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4134797261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]: dispatch 2024-05-06T13:02:52.581 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:52 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]: dispatch 2024-05-06T13:02:53.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: Adding iSCSI gateway http://:@172.21.15.16:5000 to Dashboard 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi016"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi016"}]: dispatch 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:53.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s rd, 170 B/s wr, 173 op/s 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4059025260' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4134797261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]: dispatch 2024-05-06T13:02:53.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:52 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]: dispatch 2024-05-06T13:02:53.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]': finished 2024-05-06T13:02:53.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[22420]: osdmap e80: 8 total, 8 up, 8 in 2024-05-06T13:02:53.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/464222286' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]: dispatch 2024-05-06T13:02:53.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]: dispatch 2024-05-06T13:02:53.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]': finished 2024-05-06T13:02:53.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[27395]: osdmap e80: 8 total, 8 up, 8 in 2024-05-06T13:02:53.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/464222286' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]: dispatch 2024-05-06T13:02:53.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:53 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]: dispatch 2024-05-06T13:02:54.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:53 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3572509176"}]': finished 2024-05-06T13:02:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:53 smithi186 ceph-mon[23420]: osdmap e80: 8 total, 8 up, 8 in 2024-05-06T13:02:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:53 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/464222286' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]: dispatch 2024-05-06T13:02:54.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:53 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]: dispatch 2024-05-06T13:02:54.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:54] "GET /metrics HTTP/1.1" 200 214828 "" "Prometheus/2.33.4" 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]': finished 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[22420]: osdmap e81: 8 total, 8 up, 8 in 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[22420]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 1 op/s 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2771088314' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3596258180"}]: dispatch 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]': finished 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[27395]: osdmap e81: 8 total, 8 up, 8 in 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[27395]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 1 op/s 2024-05-06T13:02:54.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:54 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2771088314' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3596258180"}]: dispatch 2024-05-06T13:02:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:54 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3953946814"}]': finished 2024-05-06T13:02:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:54 smithi186 ceph-mon[23420]: osdmap e81: 8 total, 8 up, 8 in 2024-05-06T13:02:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:54 smithi186 ceph-mon[23420]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 127 B/s wr, 1 op/s 2024-05-06T13:02:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:54 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2771088314' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3596258180"}]: dispatch 2024-05-06T13:02:55.261 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:55.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2771088314' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3596258180"}]': finished 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[27395]: osdmap e82: 8 total, 8 up, 8 in 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4266746019' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]: dispatch 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]: dispatch 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2771088314' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3596258180"}]': finished 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[22420]: osdmap e82: 8 total, 8 up, 8 in 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4266746019' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]: dispatch 2024-05-06T13:02:55.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]: dispatch 2024-05-06T13:02:55.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:56.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:55 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2771088314' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3596258180"}]': finished 2024-05-06T13:02:56.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:55 smithi186 ceph-mon[23420]: osdmap e82: 8 total, 8 up, 8 in 2024-05-06T13:02:56.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:55 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4266746019' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]: dispatch 2024-05-06T13:02:56.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:55 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]: dispatch 2024-05-06T13:02:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:56.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]': finished 2024-05-06T13:02:56.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[22420]: osdmap e83: 8 total, 8 up, 8 in 2024-05-06T13:02:56.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[22420]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 2 op/s 2024-05-06T13:02:56.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4243092577' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1703766038"}]: dispatch 2024-05-06T13:02:56.852 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:56.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]': finished 2024-05-06T13:02:56.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[27395]: osdmap e83: 8 total, 8 up, 8 in 2024-05-06T13:02:56.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[27395]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 2 op/s 2024-05-06T13:02:56.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4243092577' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1703766038"}]: dispatch 2024-05-06T13:02:56.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:56 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:57.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:56 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1703766038"}]': finished 2024-05-06T13:02:57.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:56 smithi186 ceph-mon[23420]: osdmap e83: 8 total, 8 up, 8 in 2024-05-06T13:02:57.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:56 smithi186 ceph-mon[23420]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 2 op/s 2024-05-06T13:02:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:56 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4243092577' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1703766038"}]: dispatch 2024-05-06T13:02:57.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:56 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:57.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:02:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:02:57] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:02:57.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:57 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4243092577' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1703766038"}]': finished 2024-05-06T13:02:57.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:57 smithi186 ceph-mon[23420]: osdmap e84: 8 total, 8 up, 8 in 2024-05-06T13:02:57.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:57 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3905091410' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1674941589"}]: dispatch 2024-05-06T13:02:57.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:57 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4243092577' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1703766038"}]': finished 2024-05-06T13:02:57.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:57 smithi016 ceph-mon[22420]: osdmap e84: 8 total, 8 up, 8 in 2024-05-06T13:02:57.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:57 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3905091410' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1674941589"}]: dispatch 2024-05-06T13:02:57.777 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:57 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4243092577' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1703766038"}]': finished 2024-05-06T13:02:57.777 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:57 smithi016 ceph-mon[27395]: osdmap e84: 8 total, 8 up, 8 in 2024-05-06T13:02:57.777 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:57 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3905091410' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1674941589"}]: dispatch 2024-05-06T13:02:58.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:02:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:02:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:02:58.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3905091410' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1674941589"}]': finished 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: osdmap e85: 8 total, 8 up, 8 in 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2079177911' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/957904688"}]: dispatch 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3905091410' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1674941589"}]': finished 2024-05-06T13:02:58.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: osdmap e85: 8 total, 8 up, 8 in 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2079177911' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/957904688"}]: dispatch 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:58.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:58 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3905091410' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1674941589"}]': finished 2024-05-06T13:02:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: osdmap e85: 8 total, 8 up, 8 in 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2079177911' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/957904688"}]: dispatch 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:02:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:58 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:02:59.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:59 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2079177911' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/957904688"}]': finished 2024-05-06T13:02:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:59 smithi016 ceph-mon[22420]: osdmap e86: 8 total, 8 up, 8 in 2024-05-06T13:02:59.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:02:59 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2314691729' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3592322858"}]: dispatch 2024-05-06T13:02:59.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:59 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2079177911' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/957904688"}]': finished 2024-05-06T13:02:59.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:59 smithi016 ceph-mon[27395]: osdmap e86: 8 total, 8 up, 8 in 2024-05-06T13:02:59.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:02:59 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2314691729' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3592322858"}]: dispatch 2024-05-06T13:03:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:59 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2079177911' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/957904688"}]': finished 2024-05-06T13:03:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:59 smithi186 ceph-mon[23420]: osdmap e86: 8 total, 8 up, 8 in 2024-05-06T13:03:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:02:59 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2314691729' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3592322858"}]: dispatch 2024-05-06T13:03:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2314691729' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3592322858"}]': finished 2024-05-06T13:03:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[22420]: osdmap e87: 8 total, 8 up, 8 in 2024-05-06T13:03:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[22420]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3769931836' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]: dispatch 2024-05-06T13:03:00.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]: dispatch 2024-05-06T13:03:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2314691729' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3592322858"}]': finished 2024-05-06T13:03:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[27395]: osdmap e87: 8 total, 8 up, 8 in 2024-05-06T13:03:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[27395]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3769931836' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]: dispatch 2024-05-06T13:03:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:00 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]: dispatch 2024-05-06T13:03:01.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:00 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2314691729' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3592322858"}]': finished 2024-05-06T13:03:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:00 smithi186 ceph-mon[23420]: osdmap e87: 8 total, 8 up, 8 in 2024-05-06T13:03:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:00 smithi186 ceph-mon[23420]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:00 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3769931836' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]: dispatch 2024-05-06T13:03:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:00 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]: dispatch 2024-05-06T13:03:01.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:01 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]': finished 2024-05-06T13:03:01.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:01 smithi186 ceph-mon[23420]: osdmap e88: 8 total, 8 up, 8 in 2024-05-06T13:03:01.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:01 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3318481356' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]: dispatch 2024-05-06T13:03:01.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:01 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]: dispatch 2024-05-06T13:03:01.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]': finished 2024-05-06T13:03:01.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[22420]: osdmap e88: 8 total, 8 up, 8 in 2024-05-06T13:03:01.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3318481356' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]: dispatch 2024-05-06T13:03:01.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]: dispatch 2024-05-06T13:03:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1535678464"}]': finished 2024-05-06T13:03:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[27395]: osdmap e88: 8 total, 8 up, 8 in 2024-05-06T13:03:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3318481356' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]: dispatch 2024-05-06T13:03:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:01 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]: dispatch 2024-05-06T13:03:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:02 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]': finished 2024-05-06T13:03:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:02 smithi186 ceph-mon[23420]: osdmap e89: 8 total, 8 up, 8 in 2024-05-06T13:03:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:02 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:02 smithi186 ceph-mon[23420]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:03:02.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:02 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1495141652' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1535678464"}]: dispatch 2024-05-06T13:03:02.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:03:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:03:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]': finished 2024-05-06T13:03:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[22420]: osdmap e89: 8 total, 8 up, 8 in 2024-05-06T13:03:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[22420]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:03:02.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1495141652' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1535678464"}]: dispatch 2024-05-06T13:03:02.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/957904688"}]': finished 2024-05-06T13:03:02.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[27395]: osdmap e89: 8 total, 8 up, 8 in 2024-05-06T13:03:02.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:02.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[27395]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:03:02.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:02 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1495141652' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1535678464"}]: dispatch 2024-05-06T13:03:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1495141652' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1535678464"}]': finished 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[27395]: osdmap e90: 8 total, 8 up, 8 in 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/849005542' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]: dispatch 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]: dispatch 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1495141652' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1535678464"}]': finished 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[22420]: osdmap e90: 8 total, 8 up, 8 in 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/849005542' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]: dispatch 2024-05-06T13:03:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:03 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]: dispatch 2024-05-06T13:03:04.011 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:03 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1495141652' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1535678464"}]': finished 2024-05-06T13:03:04.011 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:03 smithi186 ceph-mon[23420]: osdmap e90: 8 total, 8 up, 8 in 2024-05-06T13:03:04.011 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:03 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:04.011 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:03 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:04.011 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:03 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/849005542' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]: dispatch 2024-05-06T13:03:04.011 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:03 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]: dispatch 2024-05-06T13:03:04.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:04 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:04] "GET /metrics HTTP/1.1" 200 214828 "" "Prometheus/2.33.4" 2024-05-06T13:03:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]': finished 2024-05-06T13:03:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[27395]: osdmap e91: 8 total, 8 up, 8 in 2024-05-06T13:03:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[27395]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/434264240' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]: dispatch 2024-05-06T13:03:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]: dispatch 2024-05-06T13:03:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]': finished 2024-05-06T13:03:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[22420]: osdmap e91: 8 total, 8 up, 8 in 2024-05-06T13:03:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[22420]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/434264240' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]: dispatch 2024-05-06T13:03:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:04 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]: dispatch 2024-05-06T13:03:05.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:04 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1546528134"}]': finished 2024-05-06T13:03:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:04 smithi186 ceph-mon[23420]: osdmap e91: 8 total, 8 up, 8 in 2024-05-06T13:03:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:04 smithi186 ceph-mon[23420]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:04 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/434264240' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]: dispatch 2024-05-06T13:03:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:04 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]: dispatch 2024-05-06T13:03:06.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:05 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]': finished 2024-05-06T13:03:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:05 smithi186 ceph-mon[23420]: osdmap e92: 8 total, 8 up, 8 in 2024-05-06T13:03:06.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:05 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3914673615' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/101050378"}]: dispatch 2024-05-06T13:03:06.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:05 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]': finished 2024-05-06T13:03:06.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:05 smithi016 ceph-mon[22420]: osdmap e92: 8 total, 8 up, 8 in 2024-05-06T13:03:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:05 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3914673615' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/101050378"}]: dispatch 2024-05-06T13:03:06.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:05 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2640820386"}]': finished 2024-05-06T13:03:06.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:05 smithi016 ceph-mon[27395]: osdmap e92: 8 total, 8 up, 8 in 2024-05-06T13:03:06.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:05 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3914673615' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/101050378"}]: dispatch 2024-05-06T13:03:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:06 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3914673615' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/101050378"}]': finished 2024-05-06T13:03:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:06 smithi186 ceph-mon[23420]: osdmap e93: 8 total, 8 up, 8 in 2024-05-06T13:03:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:06 smithi186 ceph-mon[23420]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:06 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3571675087' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3583175826"}]: dispatch 2024-05-06T13:03:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3914673615' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/101050378"}]': finished 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[22420]: osdmap e93: 8 total, 8 up, 8 in 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[22420]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3571675087' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3583175826"}]: dispatch 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3914673615' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/101050378"}]': finished 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[27395]: osdmap e93: 8 total, 8 up, 8 in 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[27395]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:06 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3571675087' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3583175826"}]: dispatch 2024-05-06T13:03:07.740 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:03:07 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:07] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:03:08.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:07 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3571675087' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3583175826"}]': finished 2024-05-06T13:03:08.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:07 smithi186 ceph-mon[23420]: osdmap e94: 8 total, 8 up, 8 in 2024-05-06T13:03:08.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:07 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4060413375' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]: dispatch 2024-05-06T13:03:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:07 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]: dispatch 2024-05-06T13:03:08.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3571675087' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3583175826"}]': finished 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[22420]: osdmap e94: 8 total, 8 up, 8 in 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4060413375' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]: dispatch 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]: dispatch 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3571675087' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3583175826"}]': finished 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[27395]: osdmap e94: 8 total, 8 up, 8 in 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4060413375' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]: dispatch 2024-05-06T13:03:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:07 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]: dispatch 2024-05-06T13:03:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:08 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]': finished 2024-05-06T13:03:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:08 smithi186 ceph-mon[23420]: osdmap e95: 8 total, 8 up, 8 in 2024-05-06T13:03:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:08 smithi186 ceph-mon[23420]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:09.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:08 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]': finished 2024-05-06T13:03:09.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:08 smithi016 ceph-mon[22420]: osdmap e95: 8 total, 8 up, 8 in 2024-05-06T13:03:09.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:08 smithi016 ceph-mon[22420]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:09.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:08 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1876005166"}]': finished 2024-05-06T13:03:09.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:08 smithi016 ceph-mon[27395]: osdmap e95: 8 total, 8 up, 8 in 2024-05-06T13:03:09.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:08 smithi016 ceph-mon[27395]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:11.668 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:11 smithi016 ceph-mon[22420]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-05-06T13:03:11.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:11 smithi016 ceph-mon[27395]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-05-06T13:03:11.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:11 smithi186 ceph-mon[23420]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-05-06T13:03:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:13 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:13 smithi016 ceph-mon[22420]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-05-06T13:03:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:13 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:13 smithi016 ceph-mon[27395]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-05-06T13:03:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:13 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:13 smithi186 ceph-mon[23420]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-05-06T13:03:14.070 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:03:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:03:14.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:14] "GET /metrics HTTP/1.1" 200 214862 "" "Prometheus/2.33.4" 2024-05-06T13:03:15.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:14 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:15.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:14 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:15.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:14 smithi186 ceph-mon[23420]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:15.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:14 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:14 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:14 smithi016 ceph-mon[22420]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:14 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:14 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:14 smithi016 ceph-mon[27395]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:16 smithi016 ceph-mon[22420]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:03:17.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:16 smithi016 ceph-mon[27395]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:03:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:16 smithi186 ceph-mon[23420]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:03:17.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:03:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:17] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:03:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:18 smithi016 ceph-mon[22420]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1012 B/s rd, 0 op/s 2024-05-06T13:03:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:18 smithi016 ceph-mon[27395]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1012 B/s rd, 0 op/s 2024-05-06T13:03:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:18 smithi186 ceph-mon[23420]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1012 B/s rd, 0 op/s 2024-05-06T13:03:21.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:21 smithi016 ceph-mon[22420]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:21 smithi016 ceph-mon[27395]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:21 smithi186 ceph-mon[23420]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:03:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:03:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:03:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:03:22.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:03:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:03:23.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:03:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[22420]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[27395]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:23.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:23.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:23 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:23.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:23 smithi186 ceph-mon[23420]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:23.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:23.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:24.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:24] "GET /metrics HTTP/1.1" 200 214803 "" "Prometheus/2.33.4" 2024-05-06T13:03:25.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:25 smithi016 ceph-mon[22420]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:25 smithi016 ceph-mon[27395]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:25.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:25 smithi186 ceph-mon[23420]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:27.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:27 smithi016 ceph-mon[22420]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:27.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:27 smithi016 ceph-mon[27395]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:27.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:27 smithi186 ceph-mon[23420]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:27.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:03:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:27] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:03:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:29 smithi016 ceph-mon[22420]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:29.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:29 smithi016 ceph-mon[27395]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:29 smithi186 ceph-mon[23420]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:31.593 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:31 smithi016 ceph-mon[22420]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:31.593 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:31 smithi016 ceph-mon[27395]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:31.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:31 smithi186 ceph-mon[23420]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:33 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:33 smithi016 ceph-mon[22420]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:33.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:33 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:33.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:33 smithi016 ceph-mon[27395]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:33 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:33 smithi186 ceph-mon[23420]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:34.162 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:03:33] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:03:34.916 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:34] "GET /metrics HTTP/1.1" 200 214803 "" "Prometheus/2.33.4" 2024-05-06T13:03:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:34 smithi016 ceph-mon[22420]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:34 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:35.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:34 smithi016 ceph-mon[27395]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:35.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:35.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:34 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:34 smithi186 ceph-mon[23420]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:34 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:37.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:36 smithi016 ceph-mon[22420]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:36 smithi016 ceph-mon[27395]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:36 smithi186 ceph-mon[23420]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:37.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:03:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:37] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:03:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:38 smithi016 ceph-mon[22420]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:38 smithi016 ceph-mon[27395]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:38 smithi186 ceph-mon[23420]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:41.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:41 smithi016 ceph-mon[22420]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:41.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:41 smithi016 ceph-mon[27395]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:41 smithi186 ceph-mon[23420]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:43.378 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:03:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:03:43.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[22420]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[27395]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:43 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:43.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:43 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:43.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:43 smithi186 ceph-mon[23420]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:43.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:43 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:43.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:43 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:44.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:44] "GET /metrics HTTP/1.1" 200 214767 "" "Prometheus/2.33.4" 2024-05-06T13:03:45.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:45 smithi016 ceph-mon[22420]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:45.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:45 smithi016 ceph-mon[27395]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:45.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:45 smithi186 ceph-mon[23420]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:47 smithi016 ceph-mon[27395]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:47 smithi016 ceph-mon[22420]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:47 smithi186 ceph-mon[23420]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:47.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:03:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:47] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:03:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:49 smithi016 ceph-mon[22420]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:49.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:49 smithi016 ceph-mon[27395]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:49 smithi186 ceph-mon[23420]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:51.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:51 smithi016 ceph-mon[22420]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:51.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:51 smithi016 ceph-mon[27395]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:51 smithi186 ceph-mon[23420]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:53.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:53 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:53.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:53 smithi016 ceph-mon[22420]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:53.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:53 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:53.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:53 smithi016 ceph-mon[27395]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:53 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:03:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:53 smithi186 ceph-mon[23420]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:54.115 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:03:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:03:54.869 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:03:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:54] "GET /metrics HTTP/1.1" 200 214757 "" "Prometheus/2.33.4" 2024-05-06T13:03:55.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:55 smithi016 ceph-mon[22420]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:55.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:55.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:55 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:55.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:55 smithi016 ceph-mon[27395]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:55.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:55.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:55 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:55 smithi186 ceph-mon[23420]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:55 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:57 smithi016 ceph-mon[22420]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:57 smithi016 ceph-mon[27395]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:57.447 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:57 smithi186 ceph-mon[23420]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:03:57.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:03:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:03:57] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[22420]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[27395]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:03:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:03:59 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:03:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:59 smithi186 ceph-mon[23420]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:03:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:59 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:03:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:59 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:03:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:03:59 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:01.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:01 smithi016 ceph-mon[22420]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:01.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:01 smithi016 ceph-mon[27395]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:01 smithi186 ceph-mon[23420]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:03.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:04:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:04:03.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[27395]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[22420]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:03 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:03 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:03 smithi186 ceph-mon[23420]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:03 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:03 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:04.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:04 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:04] "GET /metrics HTTP/1.1" 200 214757 "" "Prometheus/2.33.4" 2024-05-06T13:04:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:05 smithi186 ceph-mon[23420]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:05.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:05 smithi016 ceph-mon[22420]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:05.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:05 smithi016 ceph-mon[27395]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:07.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:07 smithi016 ceph-mon[22420]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:07.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:07 smithi016 ceph-mon[27395]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:07 smithi186 ceph-mon[23420]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:07.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:04:07 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:07] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:04:09.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:09 smithi016 ceph-mon[22420]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:09.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:09 smithi016 ceph-mon[27395]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:09.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:09 smithi186 ceph-mon[23420]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:11 smithi016 ceph-mon[22420]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:11.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:11 smithi016 ceph-mon[27395]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:11 smithi186 ceph-mon[23420]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:13.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:13 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:13 smithi016 ceph-mon[22420]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:13 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:13 smithi016 ceph-mon[27395]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:13 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:13.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:13 smithi186 ceph-mon[23420]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:14.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:04:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:04:14.871 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:14] "GET /metrics HTTP/1.1" 200 214760 "" "Prometheus/2.33.4" 2024-05-06T13:04:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:15 smithi016 ceph-mon[22420]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:15.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:15 smithi016 ceph-mon[27395]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:15.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:15.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:15 smithi186 ceph-mon[23420]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:17 smithi016 ceph-mon[22420]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:17.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:17 smithi016 ceph-mon[27395]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:17.446 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:17 smithi186 ceph-mon[23420]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:17.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:04:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:17] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:04:19.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:19 smithi016 ceph-mon[22420]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:19.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:19 smithi016 ceph-mon[27395]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:19 smithi186 ceph-mon[23420]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:21.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:21 smithi016 ceph-mon[22420]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:21 smithi016 ceph-mon[27395]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:21 smithi186 ceph-mon[23420]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:04:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:04:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:04:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:04:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:04:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:04:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:04:22.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:04:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:04:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:04:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:04:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:04:23.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:04:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[27395]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[22420]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:23 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:23 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:23 smithi186 ceph-mon[23420]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:23 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:24.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:24] "GET /metrics HTTP/1.1" 200 214769 "" "Prometheus/2.33.4" 2024-05-06T13:04:25.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:25 smithi016 ceph-mon[22420]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:25.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:25 smithi016 ceph-mon[27395]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:25.690 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:25 smithi186 ceph-mon[23420]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:27.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:27 smithi016 ceph-mon[22420]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:27.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:27 smithi016 ceph-mon[27395]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:27.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:27 smithi186 ceph-mon[23420]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:27.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:04:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:27] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:04:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:29 smithi016 ceph-mon[22420]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:29.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:29 smithi016 ceph-mon[27395]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:29.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:29 smithi186 ceph-mon[23420]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:31.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:31 smithi016 ceph-mon[22420]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:31.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:31 smithi016 ceph-mon[27395]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:31.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:31 smithi186 ceph-mon[23420]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:33.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:33 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:33.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:33 smithi016 ceph-mon[22420]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:33 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:33 smithi016 ceph-mon[27395]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:33 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:33 smithi186 ceph-mon[23420]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:34.571 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:04:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:04:34.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:34] "GET /metrics HTTP/1.1" 200 214769 "" "Prometheus/2.33.4" 2024-05-06T13:04:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:35 smithi186 ceph-mon[23420]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:35 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:35 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:35.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:35 smithi016 ceph-mon[22420]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:35.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:35 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:35.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:35 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:35.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:35 smithi016 ceph-mon[27395]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:35.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:35 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:35.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:35 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:37.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:37 smithi016 ceph-mon[22420]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:37 smithi016 ceph-mon[27395]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:37.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:04:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:37] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:04:37.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:37 smithi186 ceph-mon[23420]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:39.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-06T13:04:39.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:39 smithi016 ceph-mon[22420]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:39.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:39 smithi016 ceph-mon[27395]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:39.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:39 smithi186 ceph-mon[23420]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:41.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:41 smithi016 ceph-mon[22420]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:41.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:41 smithi016 ceph-mon[27395]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:41.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-06T13:04:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:41 smithi186 ceph-mon[23420]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:43.483 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:04:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:04:43.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:43.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[22420]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:43.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:43.484 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:43.485 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:43.485 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[27395]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:43.485 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:43.485 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:43 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:43.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:43 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:43.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:43 smithi186 ceph-mon[23420]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:43.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:43 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:43.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:43 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:44.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-06T13:04:44.856 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:44] "GET /metrics HTTP/1.1" 200 214782 "" "Prometheus/2.33.4" 2024-05-06T13:04:45.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:45 smithi016 ceph-mon[22420]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:45.563 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:45 smithi016 ceph-mon[27395]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:45.695 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:45 smithi186 ceph-mon[23420]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:46.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-06T13:04:47.447 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:47 smithi186 ceph-mon[23420]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:47.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:47 smithi016 ceph-mon[22420]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:47.562 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:47 smithi016 ceph-mon[27395]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:47.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:04:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:47] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:04:49.076 INFO:teuthology.orchestra.run.smithi016.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[22420]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[27395]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:49.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:04:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:04:49.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:49 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:49.732 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T13:04:49.743 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-05-06T13:04:49.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-05-06T13:04:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:49 smithi186 ceph-mon[23420]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:04:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:49 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:04:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:49 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:50.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:50 smithi016 ceph-mon[22420]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:50 smithi016 ceph-mon[22420]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:50.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:50 smithi016 ceph-mon[22420]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:50.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:50 smithi016 ceph-mon[27395]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:50.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:50 smithi016 ceph-mon[27395]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:50.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:50 smithi016 ceph-mon[27395]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:50 smithi186 ceph-mon[23420]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:50 smithi186 ceph-mon[23420]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:50 smithi186 ceph-mon[23420]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:04:51.501 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:51 smithi016 ceph-mon[22420]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:51.501 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:51 smithi016 ceph-mon[27395]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:51 smithi186 ceph-mon[23420]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:52.214 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:04:53.139 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:04:53.139 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 18s ago 8m - - 2024-05-06T13:04:53.139 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 9s ago 8m - - 2024-05-06T13:04:53.139 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (2m) 18s ago 3m 23.5M - ba2b418f427c 948f7a58173a 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (3m) 9s ago 3m 55.5M - 8.3.5 dad864ee21e9 e49b00504c24 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (2m) 18s ago 2m 50.5M - 3.5 e1d6a67b021e 30e6b3dea831 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443 running (7m) 9s ago 7m 411M - 17.2.0 e1d6a67b021e 492589c00b6d 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:9283 running (9m) 18s ago 9m 462M - 17.2.0 e1d6a67b021e df15cc29df07 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (9m) 18s ago 9m 48.1M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (8m) 9s ago 8m 39.6M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (8m) 18s ago 8m 40.8M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (3m) 18s ago 3m 14.0M - 1dbe0e931976 ec2ab4c4cf5d 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (3m) 9s ago 3m 16.8M - 1dbe0e931976 e512d80e1b8a 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 18s ago 7m 50.5M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (7m) 18s ago 7m 52.0M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:04:53.140 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (6m) 18s ago 6m 47.1M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (6m) 18s ago 6m 48.0M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (6m) 9s ago 6m 50.6M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (5m) 9s ago 5m 51.0M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (5m) 9s ago 5m 47.5M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (4m) 9s ago 4m 49.2M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (2m) 9s ago 4m 62.2M - 514e6a882f6e 821eed79b33a 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (2m) 18s ago 2m 71.2M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (2m) 9s ago 2m 69.6M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (2m) 18s ago 2m 71.3M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:04:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (2m) 9s ago 2m 69.3M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:04:53.627 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:04:53.628 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:04:53.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:53 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:53.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:53 smithi016 ceph-mon[22420]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:53.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:53 smithi016 ceph-mon[22420]: from='client.24976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:53.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:53 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:53.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:53 smithi016 ceph-mon[27395]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:53.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:53 smithi016 ceph-mon[27395]: from='client.24976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:53 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:04:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:53 smithi186 ceph-mon[23420]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:53 smithi186 ceph-mon[23420]: from='client.24976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.049 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:04:54.050 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:04:54.050 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:04:54.050 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-05-06T13:04:54.050 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "", 2024-05-06T13:04:54.050 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa image" 2024-05-06T13:04:54.050 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:04:54.550 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:04:54.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[22420]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[22420]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3663950420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:04:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:04:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:54] "GET /metrics HTTP/1.1" 200 214766 "" "Prometheus/2.33.4" 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[27395]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[27395]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3663950420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:04:54.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:54.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:54.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:54 smithi186 ceph-mon[23420]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:54 smithi186 ceph-mon[23420]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:54.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:54 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3663950420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:04:54.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:54.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:04:55.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:55 smithi016 ceph-mon[22420]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:55.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:55 smithi016 ceph-mon[22420]: from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:55.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:55 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3220484501' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:04:55.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:55 smithi016 ceph-mon[27395]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:55.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:55 smithi016 ceph-mon[27395]: from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:55.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:55 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3220484501' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:04:55.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:55 smithi186 ceph-mon[23420]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:55.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:55 smithi186 ceph-mon[23420]: from='client.25000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:04:55.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:55 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3220484501' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:04:57.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:57 smithi016 ceph-mon[22420]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:57.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:57 smithi016 ceph-mon[27395]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:57.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:57 smithi186 ceph-mon[23420]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:04:57.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:04:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:04:57] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:04:59.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:04:59 smithi016 ceph-mon[22420]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:59.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:04:59 smithi016 ceph-mon[27395]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:04:59.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:04:59 smithi186 ceph-mon[23420]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:01.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:01 smithi016 ceph-mon[22420]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:01.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:01 smithi016 ceph-mon[27395]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:01 smithi186 ceph-mon[23420]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:03.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:05:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:05:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[22420]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:03.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:03.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[27395]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:03.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:03 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:03 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:03 smithi186 ceph-mon[23420]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:03 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:03 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:04.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:04 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:04] "GET /metrics HTTP/1.1" 200 214766 "" "Prometheus/2.33.4" 2024-05-06T13:05:05.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:05 smithi016 ceph-mon[22420]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:05.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:05 smithi016 ceph-mon[27395]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:05.686 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:05 smithi186 ceph-mon[23420]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:07.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:07 smithi016 ceph-mon[22420]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:07.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:07 smithi016 ceph-mon[27395]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:07.754 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:07 smithi186 ceph-mon[23420]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:07.755 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:07 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:07] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:05:08.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:08 smithi186 ceph-mon[23420]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:08.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:08 smithi016 ceph-mon[22420]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:08.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:08 smithi016 ceph-mon[27395]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:11.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:11 smithi016 ceph-mon[22420]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:11.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:11 smithi016 ceph-mon[27395]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:11 smithi186 ceph-mon[23420]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:13.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:13 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:13.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:13 smithi016 ceph-mon[22420]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:13.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:13 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:13 smithi016 ceph-mon[27395]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:13 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:13 smithi186 ceph-mon[23420]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:14.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:05:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:05:14.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:14] "GET /metrics HTTP/1.1" 200 214748 "" "Prometheus/2.33.4" 2024-05-06T13:05:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:15 smithi016 ceph-mon[22420]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:15.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:15.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:15 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:15 smithi016 ceph-mon[27395]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:15 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:15.716 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:15 smithi186 ceph-mon[23420]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:15.716 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:15.717 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:15 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:17.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:17 smithi016 ceph-mon[22420]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:17.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:17 smithi016 ceph-mon[27395]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:17.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:17 smithi186 ceph-mon[23420]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:17.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:17] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:05:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: Upgrade: Target is version 19.0.0-2498-g70ce9539 (unknown) 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0150ca77ab7330820ade0517ccbade81a6c60dbd326dfc0e8f481c3af7950ccb'] 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[22420]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa on smithi186 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: Upgrade: Target is version 19.0.0-2498-g70ce9539 (unknown) 2024-05-06T13:05:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0150ca77ab7330820ade0517ccbade81a6c60dbd326dfc0e8f481c3af7950ccb'] 2024-05-06T13:05:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:05:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:05:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:19 smithi016 ceph-mon[27395]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa on smithi186 2024-05-06T13:05:19.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:19.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:19.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: Upgrade: Target is version 19.0.0-2498-g70ce9539 (unknown) 2024-05-06T13:05:19.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0150ca77ab7330820ade0517ccbade81a6c60dbd326dfc0e8f481c3af7950ccb'] 2024-05-06T13:05:19.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:05:19.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:19.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:05:19.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:19 smithi186 ceph-mon[23420]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa on smithi186 2024-05-06T13:05:21.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:21 smithi016 ceph-mon[22420]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:21.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:21 smithi016 ceph-mon[27395]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:21.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:21 smithi186 ceph-mon[23420]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:22.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:05:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:22 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:05:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:05:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:22 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:05:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:05:22.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:22 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:05:23.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:23 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:23.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:23 smithi016 ceph-mon[22420]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:23.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:05:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:05:23.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:23 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:23.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:23 smithi016 ceph-mon[27395]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:23.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:23.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:05:23.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:23.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:05:23.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:23 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:23.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:23 smithi186 ceph-mon[23420]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:24.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:24 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:24.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:24 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:24.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:24 smithi186 ceph-mon[23420]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:24.890 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:24] "GET /metrics HTTP/1.1" 200 214713 "" "Prometheus/2.33.4" 2024-05-06T13:05:24.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:24 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:24.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:24 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:24.891 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:24 smithi016 ceph-mon[22420]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:24.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:24 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:24.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:24 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:24.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:24 smithi016 ceph-mon[27395]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:24.891 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 10s ago 9m - - 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 2s ago 9m - - 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (3m) 10s ago 3m 23.5M - ba2b418f427c 948f7a58173a 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (3m) 2s ago 3m 55.8M - 8.3.5 dad864ee21e9 e49b00504c24 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (2m) 10s ago 2m 50.6M - 3.5 e1d6a67b021e 30e6b3dea831 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443 running (8m) 2s ago 8m 412M - 17.2.0 e1d6a67b021e 492589c00b6d 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:9283 running (10m) 10s ago 10m 462M - 17.2.0 e1d6a67b021e df15cc29df07 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (10m) 10s ago 10m 48.4M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:05:25.497 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (8m) 2s ago 8m 39.7M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (8m) 10s ago 8m 41.2M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (4m) 10s ago 4m 14.3M - 1dbe0e931976 ec2ab4c4cf5d 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (4m) 2s ago 4m 16.5M - 1dbe0e931976 e512d80e1b8a 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (8m) 10s ago 8m 50.7M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (7m) 10s ago 7m 52.2M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (7m) 10s ago 7m 47.2M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (6m) 10s ago 6m 48.2M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (6m) 2s ago 6m 51.0M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (6m) 2s ago 6m 51.4M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (5m) 2s ago 5m 47.8M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (5m) 2s ago 5m 49.5M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (3m) 2s ago 4m 66.5M - 514e6a882f6e 821eed79b33a 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (3m) 10s ago 3m 71.3M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (3m) 2s ago 2m 69.7M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:05:25.498 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (2m) 10s ago 2m 71.4M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:05:25.499 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (2m) 2s ago 2m 69.5M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:05:25.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:25 smithi186 ceph-mon[23420]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:25.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:25 smithi186 ceph-mon[23420]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:25.859 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:05:25.859 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:05:25.859 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:05:25.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:05:25.859 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:05:25.860 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:05:25.861 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:25 smithi016 ceph-mon[22420]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:25.861 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:25 smithi016 ceph-mon[22420]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:25.861 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:25 smithi016 ceph-mon[27395]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:25.861 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:25 smithi016 ceph-mon[27395]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:26.168 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:05:26.168 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:05:26.169 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:05:26.169 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-05-06T13:05:26.169 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "0/23 daemons upgraded", 2024-05-06T13:05:26.169 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa image on host smithi186" 2024-05-06T13:05:26.169 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:05:26.539 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:05:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:26 smithi186 ceph-mon[23420]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:26 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2990296102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:05:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:26 smithi186 ceph-mon[23420]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:26 smithi186 ceph-mon[23420]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:26.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[22420]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:26.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2990296102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:05:26.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[22420]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:26.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[22420]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:26.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[27395]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:26.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2990296102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:05:26.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[27395]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:26.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:26 smithi016 ceph-mon[27395]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:05:27.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:27] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:05:27.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:27 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1703632229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:05:27.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:27 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1703632229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:05:27.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:27 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1703632229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:05:28.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:28 smithi186 ceph-mon[23420]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:28.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:28 smithi016 ceph-mon[22420]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:28.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:28 smithi016 ceph-mon[27395]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:31.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:31 smithi016 ceph-mon[22420]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:31.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:31 smithi016 ceph-mon[27395]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:31.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:31 smithi186 ceph-mon[23420]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:33.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:33 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:33.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:33 smithi016 ceph-mon[22420]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:33 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:33.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:33 smithi016 ceph-mon[27395]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:33.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=error ts=2024-05-06T13:05:33.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:05:33.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:05:33.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:33 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:05:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:33 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:33 smithi186 ceph-mon[23420]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:34.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:34] "GET /metrics HTTP/1.1" 200 214713 "" "Prometheus/2.33.4" 2024-05-06T13:05:34.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:05:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:05:35.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:35 smithi016 ceph-mon[22420]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:35.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:35 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:35.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:35 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:35.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:35 smithi016 ceph-mon[27395]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:35.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:35 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:35.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:35 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:35 smithi186 ceph-mon[23420]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:35 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:35 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:37.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:37 smithi016 ceph-mon[22420]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:37.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:37 smithi016 ceph-mon[27395]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:37.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:37 smithi186 ceph-mon[23420]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:37.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:37] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:05:39.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:39 smithi016 ceph-mon[22420]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:39.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:39 smithi016 ceph-mon[27395]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:39.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:39 smithi186 ceph-mon[23420]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:41.585 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:41 smithi016 ceph-mon[22420]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:41.586 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:41 smithi016 ceph-mon[27395]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:41 smithi186 ceph-mon[23420]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:43.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:43 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:43.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:43 smithi016 ceph-mon[22420]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:43.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.186 - - [06/May/2024:13:05:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:05:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:43 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:43.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:43 smithi016 ceph-mon[27395]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:43.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=error ts=2024-05-06T13:05:43.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:05:43.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:43.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:05:43.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:43.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:05:43.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:43 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:43.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:43 smithi186 ceph-mon[23420]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:44.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:44 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:44.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:44 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:44.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:44 smithi016 ceph-mon[22420]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:44.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:44 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:44.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:44 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:44.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:44 smithi016 ceph-mon[27395]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:44.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:44] "GET /metrics HTTP/1.1" 200 214713 "" "Prometheus/2.33.4" 2024-05-06T13:05:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:44 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:44 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:44 smithi186 ceph-mon[23420]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:46 smithi186 ceph-mon[23420]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:47.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:46 smithi016 ceph-mon[22420]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:47.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:46 smithi016 ceph-mon[27395]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:47.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[24890]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:47] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:05:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:48 smithi186 ceph-mon[23420]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:49.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:48 smithi016 ceph-mon[22420]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:49.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:48 smithi016 ceph-mon[27395]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:50.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: Upgrade: Updating mgr.x 2024-05-06T13:05:50.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: Deploying daemon mgr.x on smithi186 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[27395]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: Upgrade: Updating mgr.x 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:05:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:05:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: Deploying daemon mgr.x on smithi186 2024-05-06T13:05:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:50 smithi016 ceph-mon[22420]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: Upgrade: Updating mgr.x 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: Deploying daemon mgr.x on smithi186 2024-05-06T13:05:50.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:50 smithi186 ceph-mon[23420]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:52.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:52 smithi186 systemd[1]: Stopping Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:05:52.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:52 smithi186 bash[48789]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr.x" found: no such container 2024-05-06T13:05:52.828 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:52 smithi186 podman[48802]: 2024-05-06 13:05:52.54806132 +0000 UTC m=+0.163233286 container died 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, architecture=x86_64, ceph=True, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, io.openshift.expose-services=, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, name=centos-stream, vcs-type=git, release=754) 2024-05-06T13:05:53.129 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:52 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:53.129 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:52 smithi186 ceph-mon[23420]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:53.129 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:52 smithi186 podman[48802]: 2024-05-06 13:05:52.885686301 +0000 UTC m=+0.500858223 container cleanup 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, vendor=Red Hat, Inc., architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, name=centos-stream, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream) 2024-05-06T13:05:53.129 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:52 smithi186 bash[48802]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x 2024-05-06T13:05:53.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:52 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:52 smithi016 ceph-mon[22420]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:53.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:52 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:05:53.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:52 smithi016 ceph-mon[27395]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:05:53.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 podman[48816]: 2024-05-06 13:05:53.129508012 +0000 UTC m=+0.576078864 container remove 492589c00b6d03ba200c7138e0c1d19ad1acc8b0857b0da97f6fe83483e741e3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., io.openshift.expose-services=, release=754, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, io.buildah.version=1.19.8, name=centos-stream, vcs-type=git) 2024-05-06T13:05:53.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:05:53.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 bash[48828]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr.x" found: no such container 2024-05-06T13:05:53.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-05-06T13:05:53.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 systemd[1]: Stopped Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:05:53.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service: Consumed 16.826s CPU time. 2024-05-06T13:05:53.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 systemd[1]: Starting Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:05:53.850 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 podman[48933]: 2024-05-06 13:05:53.494976113 +0000 UTC m=+0.018541853 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:05:53.850 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 podman[48933]: 2024-05-06 13:05:53.631298419 +0000 UTC m=+0.154864189 container create 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:05:53.850 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 podman[48933]: 2024-05-06 13:05:53.850658887 +0000 UTC m=+0.374224617 container init 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-06T13:05:53.923 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=error ts=2024-05-06T13:05:53.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:05:53.923 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:53.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.186:8443/api/prometheus_receiver\": dial tcp 172.21.15.186:8443: connect: connection refused" 2024-05-06T13:05:53.924 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:53.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:05:54.104 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 podman[48933]: 2024-05-06 13:05:53.853329857 +0000 UTC m=+0.376895591 container start 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:05:54.104 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 ceph-mgr[48952]: -- 172.21.15.186:0/2866265945 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55685958c5a0 con 0x556859561000 2024-05-06T13:05:54.104 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 bash[48933]: 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a 2024-05-06T13:05:54.104 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:53 smithi186 systemd[1]: Started Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:05:54.104 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:54.010+0000 7fd3b3b36200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:05:54.446 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:54.207+0000 7fd3b3b36200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:05:54.446 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:54.329+0000 7fd3b3b36200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:05:54.760 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:54.669+0000 7fd3b3b36200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:05:54.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:05:54] "GET /metrics HTTP/1.1" 200 214715 "" "Prometheus/2.33.4" 2024-05-06T13:05:54.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 172.21.15.16 - - [06/May/2024:13:05:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-06T13:05:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:54.760+0000 7fd3b3b36200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:05:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:05:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: Failing over to other MGR 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: osdmap e96: 8 total, 8 up, 8 in 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:54 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:05:55.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:55.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: Failing over to other MGR 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: osdmap e96: 8 total, 8 up, 8 in 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[22420]: Standby manager daemon y started 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: Failing over to other MGR 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 172.21.15.16:0/3521826712' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: osdmap e96: 8 total, 8 up, 8 in 2024-05-06T13:05:55.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' 2024-05-06T13:05:55.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:54 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:05:55.609 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:55.297+0000 7f7c81db6700 -1 mgr handle_mgr_map I was active but no longer am 2024-05-06T13:05:55.609 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setuser ceph since I am not root 2024-05-06T13:05:55.610 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ignoring --setgroup ceph since I am not root 2024-05-06T13:05:55.610 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-mgr[22652]: -- 172.21.15.16:0/4195103395 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55688f124340 con 0x55688f0fc800 2024-05-06T13:05:55.610 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:55.475+0000 7ff28bb71000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:05:55.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:55.609+0000 7ff28bb71000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:05:55.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:55.711+0000 7ff28bb71000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:05:56.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:56.010+0000 7fd3b3b36200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:05:56.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:56.181+0000 7fd3b3b36200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:05:56.292 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:56.031+0000 7ff28bb71000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:05:56.292 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:56.117+0000 7ff28bb71000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:05:56.292 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:05:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:05:56.130Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=4 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": dial tcp 172.21.15.16:8443: connect: connection refused" 2024-05-06T13:05:56.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:56 smithi186 ceph-mon[23420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-05-06T13:05:56.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:05:56 smithi186 ceph-mon[23420]: mgrmap e22: x(active, starting, since 1.00057s), standbys: y 2024-05-06T13:05:56.652 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:56.358+0000 7fd3b3b36200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:05:56.652 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:56.652+0000 7fd3b3b36200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:05:56.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:56 smithi016 ceph-mon[22420]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-05-06T13:05:56.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:05:56 smithi016 ceph-mon[22420]: mgrmap e22: x(active, starting, since 1.00057s), standbys: y 2024-05-06T13:05:56.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:56 smithi016 ceph-mon[27395]: from='mgr.14451 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-05-06T13:05:56.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:05:56 smithi016 ceph-mon[27395]: mgrmap e22: x(active, starting, since 1.00057s), standbys: y 2024-05-06T13:05:56.960 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:56.749+0000 7fd3b3b36200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:05:56.960 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:56.960+0000 7fd3b3b36200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:05:57.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:57.155+0000 7fd3b3b36200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:05:57.574 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:57.316+0000 7ff28bb71000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:05:57.574 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:57.488+0000 7ff28bb71000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:05:57.903 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:57.574+0000 7ff28bb71000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:05:58.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:57.763+0000 7fd3b3b36200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:05:58.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:57.903+0000 7ff28bb71000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:05:58.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:57.998+0000 7ff28bb71000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:05:58.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:58.095+0000 7ff28bb71000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:05:58.490 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:58.188+0000 7fd3b3b36200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:05:58.491 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:58.285+0000 7fd3b3b36200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:05:58.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:58.349+0000 7ff28bb71000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:05:58.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:58.490+0000 7fd3b3b36200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:05:59.000 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:58.826+0000 7ff28bb71000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:05:59.368 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.028+0000 7fd3b3b36200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:05:59.368 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.121+0000 7fd3b3b36200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:05:59.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:59.343+0000 7ff28bb71000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:05:59.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:59.445+0000 7ff28bb71000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:05:59.728 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.367+0000 7fd3b3b36200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:05:59.729 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.509+0000 7fd3b3b36200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:05:59.729 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.610+0000 7fd3b3b36200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:05:59.729 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.728+0000 7fd3b3b36200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:06:00.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:05:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:05:59.828+0000 7fd3b3b36200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:06:00.058 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:59.758+0000 7ff28bb71000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:06:00.058 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:05:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:05:59.855+0000 7ff28bb71000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:06:00.311 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:00.290+0000 7ff28bb71000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:06:00.672 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:00.440+0000 7ff28bb71000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:06:00.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:00.545+0000 7ff28bb71000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:06:00.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:00.673+0000 7ff28bb71000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:06:00.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:00.771+0000 7ff28bb71000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:06:01.012 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:00.731+0000 7fd3b3b36200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:06:01.012 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:00.947+0000 7fd3b3b36200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:06:01.013 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:00] ENGINE Bus STARTING 2024-05-06T13:06:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: Active manager daemon x restarted 2024-05-06T13:06:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: Activating manager daemon x 2024-05-06T13:06:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: osdmap e97: 8 total, 8 up, 8 in 2024-05-06T13:06:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: CherryPy Checker: 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: The Application mounted at '' has an empty config. 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Serving on http://:::9283 2024-05-06T13:06:01.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Bus STARTED 2024-05-06T13:06:01.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Bus STOPPING 2024-05-06T13:06:01.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:06:01.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Bus STOPPED 2024-05-06T13:06:01.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Bus STARTING 2024-05-06T13:06:01.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: Active manager daemon x restarted 2024-05-06T13:06:01.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: Activating manager daemon x 2024-05-06T13:06:01.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: osdmap e97: 8 total, 8 up, 8 in 2024-05-06T13:06:01.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:06:01.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:01.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: Active manager daemon x restarted 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: Activating manager daemon x 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: osdmap e97: 8 total, 8 up, 8 in 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:06:01.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:01.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:01.403+0000 7ff28bb71000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:06:01.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Serving on http://:::9283 2024-05-06T13:06:01.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:01] ENGINE Bus STARTED 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:01.795+0000 7ff28bb71000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:06:01] ENGINE Bus STARTING 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: CherryPy Checker: 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: The Application mounted at '' has an empty config. 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:06:01] ENGINE Serving on http://:::9283 2024-05-06T13:06:02.048 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: [06/May/2024:13:06:01] ENGINE Bus STARTED 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: mgrmap e23: x(active, starting, since 0.0611854s), standbys: y 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:06:02.049 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Manager daemon x is now available 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Queued rgw.foo for migration 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Queued rgw.smpl for migration 2024-05-06T13:06:02.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-05-06T13:06:02.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-05-06T13:06:02.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.051 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:06:02.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Standby manager daemon y restarted 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:02.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: mgrmap e23: x(active, starting, since 0.0611854s), standbys: y 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:06:02.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Manager daemon x is now available 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Queued rgw.foo for migration 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Queued rgw.smpl for migration 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:02.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Standby manager daemon y restarted 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Standby manager daemon y started 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:02 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:06:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: mgrmap e23: x(active, starting, since 0.0611854s), standbys: y 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:06:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Manager daemon x is now available 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Queued rgw.foo for migration 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Queued rgw.smpl for migration 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Standby manager daemon y restarted 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:06:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2332968062' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:02 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:02.738 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:06:02.738 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 8s ago 9m - - 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 19s ago 9m - - 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (4m) 8s ago 4m 25.9M - ba2b418f427c 948f7a58173a 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (4m) 19s ago 4m 55.8M - 8.3.5 dad864ee21e9 e49b00504c24 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (3m) 8s ago 3m 53.0M - 3.5 e1d6a67b021e 30e6b3dea831 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283 starting - - - - 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:9283 running (10m) 8s ago 10m 465M - 17.2.0 e1d6a67b021e df15cc29df07 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (10m) 8s ago 10m 50.0M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (9m) 19s ago 9m 40.6M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (9m) 8s ago 9m 41.6M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (5m) 8s ago 5m 14.6M - 1dbe0e931976 ec2ab4c4cf5d 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (5m) 19s ago 5m 16.2M - 1dbe0e931976 e512d80e1b8a 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (8m) 8s ago 8m 51.2M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (8m) 8s ago 8m 52.7M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:06:02.739 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (7m) 8s ago 7m 47.6M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (7m) 8s ago 7m 48.9M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (7m) 19s ago 7m 51.2M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (6m) 19s ago 6m 51.5M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (6m) 19s ago 6m 48.0M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (6m) 19s ago 6m 49.7M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (4m) 19s ago 5m 66.5M - 514e6a882f6e 821eed79b33a 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (3m) 8s ago 3m 71.5M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (3m) 19s ago 3m 69.9M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (3m) 8s ago 3m 71.7M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:06:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (3m) 19s ago 3m 69.6M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:06:03.163 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:06:03.163 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:06:03.163 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:06:03.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:06:03.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:03.165 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:06:03.165 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-05-06T13:06:03.165 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:06:03.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:06:03.165 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: mgrmap e24: x(active, since 1.0767s), standbys: y 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: [06/May/2024:13:06:02] ENGINE Bus STARTING 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: [06/May/2024:13:06:02] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:06:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='client.25081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: [06/May/2024:13:06:02] ENGINE Serving on https://172.21.15.186:7150 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: [06/May/2024:13:06:02] ENGINE Bus STARTED 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='client.25087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: mgrmap e24: x(active, since 1.0767s), standbys: y 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: [06/May/2024:13:06:02] ENGINE Bus STARTING 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:03.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: [06/May/2024:13:06:02] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='client.25081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: [06/May/2024:13:06:02] ENGINE Serving on https://172.21.15.186:7150 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: [06/May/2024:13:06:02] ENGINE Bus STARTED 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='client.25087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:03.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:03.510 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:06:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:06:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:06:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:06:03.510 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-05-06T13:06:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "", 2024-05-06T13:06:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-05-06T13:06:03.511 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:06:03.511 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:06:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: mgrmap e24: x(active, since 1.0767s), standbys: y 2024-05-06T13:06:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: [06/May/2024:13:06:02] ENGINE Bus STARTING 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: [06/May/2024:13:06:02] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='client.25081 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: [06/May/2024:13:06:02] ENGINE Serving on https://172.21.15.186:7150 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: [06/May/2024:13:06:02] ENGINE Bus STARTED 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='client.25087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:03 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:03.923 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=error ts=2024-05-06T13:06:03.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.16:8443//api/prometheus_receiver\": dial tcp 172.21.15.16:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.186:8443/api/prometheus_receiver\": dial tcp 172.21.15.186:8443: connect: connection refused" 2024-05-06T13:06:03.923 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:06:03.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:06:03.924 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:03 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:06:03.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:06:03.925 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:06:04.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:04.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1344830417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:06:04.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: from='client.25105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: Reconfiguring daemon agent.smithi016 on smithi016 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: Deploying cephadm binary to smithi016 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/11431985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[22420]: mgrmap e25: x(active, since 2s), standbys: y 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1344830417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: from='client.25105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: Reconfiguring daemon agent.smithi016 on smithi016 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: Deploying cephadm binary to smithi016 2024-05-06T13:06:04.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/11431985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:06:04.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:04 smithi016 ceph-mon[27395]: mgrmap e25: x(active, since 2s), standbys: y 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1344830417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: from='client.25105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: Reconfiguring daemon agent.smithi016 on smithi016 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: Deploying cephadm binary to smithi016 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/11431985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:06:04.444 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:04 smithi186 ceph-mon[23420]: mgrmap e25: x(active, since 2s), standbys: y 2024-05-06T13:06:04.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:04 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:06:06.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:06 smithi016 ceph-mon[22420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:06.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:06 smithi016 ceph-mon[22420]: mgrmap e26: x(active, since 4s), standbys: y 2024-05-06T13:06:06.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:06 smithi016 ceph-mon[27395]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:06.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:06 smithi016 ceph-mon[27395]: mgrmap e26: x(active, since 4s), standbys: y 2024-05-06T13:06:06.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:06 smithi186 ceph-mon[23420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:06.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:06 smithi186 ceph-mon[23420]: mgrmap e26: x(active, since 4s), standbys: y 2024-05-06T13:06:07.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:07 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:07] "GET /metrics HTTP/1.1" 200 35346 "" "Prometheus/2.33.4" 2024-05-06T13:06:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:07 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:07 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:07 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:07 smithi186 ceph-mon[23420]: Reconfiguring node-exporter.a (dependencies changed)... 2024-05-06T13:06:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:07 smithi186 ceph-mon[23420]: Reconfiguring daemon node-exporter.a on smithi016 2024-05-06T13:06:07.953 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:07 smithi016 systemd[1]: Stopping Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:07.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[22420]: Reconfiguring node-exporter.a (dependencies changed)... 2024-05-06T13:06:07.953 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[22420]: Reconfiguring daemon node-exporter.a on smithi016 2024-05-06T13:06:07.954 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.954 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.954 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:07.954 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[27395]: Reconfiguring node-exporter.a (dependencies changed)... 2024-05-06T13:06:07.954 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:07 smithi016 ceph-mon[27395]: Reconfiguring daemon node-exporter.a on smithi016 2024-05-06T13:06:08.265 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:07 smithi016 bash[60445]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter.a" found: no such container 2024-05-06T13:06:09.009 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:08 smithi186 ceph-mon[23420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:09.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:08 smithi016 ceph-mon[22420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:09.109 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:08 smithi016 podman[60478]: 2024-05-06 13:06:08.826988206 +0000 UTC m=+0.864331839 container died ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:09.109 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:08 smithi016 ceph-mon[27395]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:09.423 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 podman[60478]: 2024-05-06 13:06:09.291810894 +0000 UTC m=+1.329154519 container cleanup ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:09.423 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 bash[60478]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a 2024-05-06T13:06:09.423 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 bash[60543]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter.a" found: no such container 2024-05-06T13:06:09.895 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 podman[60531]: 2024-05-06 13:06:09.576783189 +0000 UTC m=+0.751237897 container remove ec2ab4c4cf5d8b86315dc2e133d8272820fb8fe69aa0872e2b1e2bdf449cceee (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 systemd[1]: Stopped Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service: Consumed 2.987s CPU time. 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 systemd[1]: Starting Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 podman[60663]: 2024-05-06 13:06:09.819367699 +0000 UTC m=+0.109599947 container create 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:09.896 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 podman[60663]: 2024-05-06 13:06:09.72875989 +0000 UTC m=+0.018992154 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-06T13:06:10.238 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 podman[60663]: 2024-05-06 13:06:09.980341215 +0000 UTC m=+0.270573464 container init 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:10.238 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 podman[60663]: 2024-05-06 13:06:09.983116726 +0000 UTC m=+0.273348975 container start 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:10.238 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.986Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-06T13:06:10.238 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.986Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.986Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.986Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=arp 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-06T13:06:10.239 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=edac 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-06T13:06:10.240 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=os 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-06T13:06:10.241 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=stat 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=time 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=uname 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.987Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-06T13:06:10.242 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.988Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-06T13:06:10.243 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a[60694]: ts=2024-05-06T13:06:09.988Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-06T13:06:10.243 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:10 smithi016 bash[60663]: 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 2024-05-06T13:06:10.243 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:06:10 smithi016 systemd[1]: Started Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:10.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:10 smithi016 ceph-mon[22420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:06:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:10 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:10 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:10 smithi016 ceph-mon[27395]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:06:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:10 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:10 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:10 smithi186 ceph-mon[23420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:06:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:10 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:10 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:11.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:11 smithi016 ceph-mon[22420]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-06T13:06:11.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:11 smithi016 ceph-mon[22420]: Reconfiguring daemon alertmanager.a on smithi016 2024-05-06T13:06:11.974 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:11 smithi016 ceph-mon[27395]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-06T13:06:11.974 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:11 smithi016 ceph-mon[27395]: Reconfiguring daemon alertmanager.a on smithi016 2024-05-06T13:06:12.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:11 smithi186 ceph-mon[23420]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-06T13:06:12.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:11 smithi186 ceph-mon[23420]: Reconfiguring daemon alertmanager.a on smithi016 2024-05-06T13:06:12.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:12 smithi016 ceph-mon[22420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-06T13:06:12.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:12 smithi016 ceph-mon[27395]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-06T13:06:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:12 smithi186 ceph-mon[23420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-06T13:06:13.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:13 smithi016 ceph-mon[22420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:13.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:13 smithi016 ceph-mon[27395]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:13.924 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=error ts=2024-05-06T13:06:13.511Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:06:13.924 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:06:13.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.16:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.16 because it doesn't contain any IP SANs" 2024-05-06T13:06:13.924 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=warn ts=2024-05-06T13:06:13.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.186:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.186 because it doesn't contain any IP SANs" 2024-05-06T13:06:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:13 smithi186 ceph-mon[23420]: from='client.14946 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:14.500 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:14 smithi016 systemd[1]: Stopping Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:14.500 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:14 smithi016 bash[61066]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager.a" found: no such container 2024-05-06T13:06:14.763 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:14 smithi016 ceph-mon[22420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:06:14.763 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:14 smithi016 ceph-mon[27395]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:06:14.764 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:06:14.764 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[48580]: level=info ts=2024-05-06T13:06:14.746Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:06:15.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:14 smithi186 ceph-mon[23420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:06:15.414 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 podman[61079]: 2024-05-06 13:06:15.213404582 +0000 UTC m=+0.814512786 container cleanup 948f7a58173a622e987ce7a62900149d2aa6f35083e5e7690b3ad3a27da5f35c (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:15.414 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 bash[61079]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a 2024-05-06T13:06:15.673 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 podman[61111]: 2024-05-06 13:06:15.414958794 +0000 UTC m=+0.643883877 container remove 948f7a58173a622e987ce7a62900149d2aa6f35083e5e7690b3ad3a27da5f35c (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:15.673 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 podman[61111]: 2024-05-06 13:06:15.499336799 +0000 UTC m=+0.728261837 volume remove ec0ab944e163f3be0b19ae3ea0eca0e2802068253d968213d6e37d849d03ba56 2024-05-06T13:06:15.673 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 bash[61135]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager.a" found: no such container 2024-05-06T13:06:15.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-06T13:06:15.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 systemd[1]: Stopped Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:15.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 systemd[1]: Starting Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:16.087 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 podman[61266]: 2024-05-06 13:06:15.81681182 +0000 UTC m=+0.116331563 volume create 1d0b9e34b575c937842cd70a83d59a32f904a8f28ad5b36e54cf2512873427ca 2024-05-06T13:06:16.087 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 podman[61266]: 2024-05-06 13:06:15.72454189 +0000 UTC m=+0.024061635 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-05-06T13:06:16.088 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:15 smithi016 podman[61266]: 2024-05-06 13:06:15.91737094 +0000 UTC m=+0.216890686 container create 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:16.630 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 podman[61266]: 2024-05-06 13:06:16.211840936 +0000 UTC m=+0.511360679 container init 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:16.630 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 podman[61266]: 2024-05-06 13:06:16.21484321 +0000 UTC m=+0.514362955 container start 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:16.630 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.225Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.225Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.227Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.16 port=9094 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.228Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.253Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.253Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.255Z caller=main.go:518 msg=Listening address=:9093 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:16.255Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 bash[61266]: 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b 2024-05-06T13:06:16.631 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:16 smithi016 systemd[1]: Started Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:16.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:16.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:16.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:16.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:16.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:16.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:16.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:16 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:17.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:17.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:17.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:17.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:17.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:17.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:17.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:16 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:17.716 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:17] "GET /metrics HTTP/1.1" 200 38146 "" "Prometheus/2.33.4" 2024-05-06T13:06:18.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:17 smithi186 ceph-mon[23420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:06:18.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:17 smithi186 ceph-mon[23420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:06:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:17 smithi016 ceph-mon[22420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:06:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:17 smithi016 ceph-mon[22420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:06:18.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:17 smithi016 ceph-mon[27395]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:06:18.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:17 smithi016 ceph-mon[27395]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:06:18.502 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:18.228Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000191312s 2024-05-06T13:06:18.785 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:18 smithi016 ceph-mon[22420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:18.785 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:18 smithi016 ceph-mon[27395]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:18 smithi186 ceph-mon[23420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:20.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:19.803+0000 7fd339777700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Creating ceph-iscsi config... 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Traceback (most recent call last): 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return _run_code(code, main_globals, None, 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: exec(code, run_globals) 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:20.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:20.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Traceback (most recent call last): 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return future.result(timeout) 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return self.__get_result() 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: raise self._exception 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: use_current_daemon_image=reconfig, 2024-05-06T13:06:20.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Creating ceph-iscsi config... 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Traceback (most recent call last): 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return _run_code(code, main_globals, None, 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: exec(code, run_globals) 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:20.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:20.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:19 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:20 smithi186 ceph-mon[23420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:21.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:20 smithi186 ceph-mon[23420]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: Creating ceph-iscsi config... 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: exec(code, run_globals) 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:21.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:06:21.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: return future.result(timeout) 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: return self.__get_result() 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: raise self._exception 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: use_current_daemon_image=reconfig, 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: Creating ceph-iscsi config... 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:21.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: exec(code, run_globals) 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:21.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:21.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:21.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:20 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:21.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:20 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[22420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[22420]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: return future.result(timeout) 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.__get_result() 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: raise self._exception 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: use_current_daemon_image=reconfig, 2024-05-06T13:06:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:21.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[27395]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[27395]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:06:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: return future.result(timeout) 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:06:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout: return self.__get_result() 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: raise self._exception 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: use_current_daemon_image=reconfig, 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.184 INFO:journalctl@ceph.mon.c.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:20 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:21 smithi186 ceph-mon[23420]: Reconfiguring daemon agent.smithi186 on smithi186 2024-05-06T13:06:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:21 smithi186 ceph-mon[23420]: Deploying cephadm binary to smithi186 2024-05-06T13:06:22.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:21 smithi016 ceph-mon[27395]: Reconfiguring daemon agent.smithi186 on smithi186 2024-05-06T13:06:22.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:21 smithi016 ceph-mon[27395]: Deploying cephadm binary to smithi186 2024-05-06T13:06:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:21 smithi016 ceph-mon[22420]: Reconfiguring daemon agent.smithi186 on smithi186 2024-05-06T13:06:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:21 smithi016 ceph-mon[22420]: Deploying cephadm binary to smithi186 2024-05-06T13:06:22.726 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:22 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:22.313Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.186:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.16:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:06:23.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:22 smithi186 ceph-mon[23420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:06:23.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:22 smithi016 ceph-mon[27395]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:06:23.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:22 smithi016 ceph-mon[22420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:06:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:24 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:24 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:24 smithi186 ceph-mon[23420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-06T13:06:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:24 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:24 smithi186 ceph-mon[23420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:06:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:24 smithi186 ceph-mon[23420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:06:24.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[22420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[22420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[22420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[27395]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:24.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[27395]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:06:24.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:24 smithi016 ceph-mon[27395]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:06:24.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[22648]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:06:26.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:26 smithi016 ceph-mon[22420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:26.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:26 smithi016 ceph-mon[27395]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:26.674 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:06:26 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:06:26.232Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003886815s 2024-05-06T13:06:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:26 smithi186 ceph-mon[23420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:27.447 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:27 smithi186 systemd[1]: Stopping Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:27.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:27] "GET /metrics HTTP/1.1" 200 38146 "" "Prometheus/2.33.4" 2024-05-06T13:06:28.220 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:27 smithi186 bash[51592]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:06:28.220 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:06:28.220 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-06T13:06:28.220 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-06T13:06:28.220 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-06T13:06:28.221 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[42722]: ts=2024-05-06T13:06:28.021Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-06T13:06:28.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:28 smithi186 ceph-mon[23420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:28.515 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 podman[51651]: 2024-05-06 13:06:28.360664448 +0000 UTC m=+0.451017052 container died 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:28.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:28 smithi016 ceph-mon[27395]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:28.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:28 smithi016 ceph-mon[22420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:28.868 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 podman[51651]: 2024-05-06 13:06:28.664875523 +0000 UTC m=+0.755228127 container cleanup 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:28.869 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 bash[51651]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a 2024-05-06T13:06:28.869 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 podman[51680]: 2024-05-06 13:06:28.849466123 +0000 UTC m=+0.821091660 container remove 821eed79b33a452d1746072e5c4a3d75d66d45ea6b42197ef88b12cc864960c6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:29.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 bash[51714]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:06:29.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-06T13:06:29.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 systemd[1]: Stopped Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:29.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service: Consumed 1.325s CPU time. 2024-05-06T13:06:29.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:28 smithi186 systemd[1]: Starting Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:29.687 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 podman[51830]: 2024-05-06 13:06:29.327620677 +0000 UTC m=+0.021512687 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-06T13:06:29.687 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 podman[51830]: 2024-05-06 13:06:29.444109616 +0000 UTC m=+0.138001660 container create 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:29.974 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 podman[51830]: 2024-05-06 13:06:29.688059418 +0000 UTC m=+0.381951423 container init 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:29.974 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 podman[51830]: 2024-05-06 13:06:29.690821188 +0000 UTC m=+0.384713198 container start 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.713Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.713Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.713Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.713Z caller=main.go:518 level=info host_details="(Linux 5.14.0-437.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 x86_64 smithi186 (none))" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.713Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.713Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.714Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.715Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.715Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.717Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.717Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.083µs 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.717Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-06T13:06:29.975 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:29.717Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-05-06T13:06:29.976 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 bash[51830]: 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 2024-05-06T13:06:29.976 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:29 smithi186 systemd[1]: Started Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:30.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.166Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-05-06T13:06:30.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.167Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-05-06T13:06:30.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.167Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=37.888µs wal_replay_duration=449.85856ms total_replay_duration=449.9169ms 2024-05-06T13:06:30.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.171Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-06T13:06:30.266 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.171Z caller=main.go:947 level=info msg="TSDB started" 2024-05-06T13:06:30.266 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.171Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-06T13:06:30.266 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.197Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=25.557417ms db_storage=765ns remote_storage=1.646µs web_handler=448ns query_engine=768ns scrape=595.548µs scrape_sd=153.788µs notify=16.461µs notify_sd=22.339µs rules=24.395653ms 2024-05-06T13:06:30.266 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:30.197Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[22420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[22420]: Reconfiguring node-exporter.b (dependencies changed)... 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[22420]: Reconfiguring daemon node-exporter.b on smithi186 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[27395]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:30.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:30.874 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:30.874 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[27395]: Reconfiguring node-exporter.b (dependencies changed)... 2024-05-06T13:06:30.874 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:30 smithi016 ceph-mon[27395]: Reconfiguring daemon node-exporter.b on smithi186 2024-05-06T13:06:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:30 smithi186 ceph-mon[23420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-06T13:06:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:30 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:30 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:30 smithi186 ceph-mon[23420]: Reconfiguring node-exporter.b (dependencies changed)... 2024-05-06T13:06:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:30 smithi186 ceph-mon[23420]: Reconfiguring daemon node-exporter.b on smithi186 2024-05-06T13:06:31.992 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:31 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:31.993 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:31 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:32.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:31 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:32.208 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:31 smithi186 systemd[1]: Stopping Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:32.834 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:32 smithi186 bash[52194]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter.b" found: no such container 2024-05-06T13:06:32.834 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:32 smithi186 podman[52259]: 2024-05-06 13:06:32.634110704 +0000 UTC m=+0.107326498 container died e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:06:33.116 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:32 smithi186 podman[52259]: 2024-05-06 13:06:32.932193847 +0000 UTC m=+0.405409638 container cleanup e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:06:33.116 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:32 smithi186 bash[52259]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b 2024-05-06T13:06:33.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:32 smithi186 ceph-mon[23420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-06T13:06:33.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:32 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1745782235' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:06:33.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:32 smithi016 ceph-mon[22420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-06T13:06:33.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:32 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1745782235' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:06:33.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:32 smithi016 ceph-mon[27395]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-06T13:06:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:32 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1745782235' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:06:33.405 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 podman[52285]: 2024-05-06 13:06:33.116901166 +0000 UTC m=+0.487124718 container remove e512d80e1b8adecfea1fb0a0bdc9efe1a305887dc4f297121168b2f1d54de9ea (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:06:33.405 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:06:33.405 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 bash[52304]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter.b" found: no such container 2024-05-06T13:06:33.406 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-06T13:06:33.406 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 systemd[1]: Stopped Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:33.406 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service: Consumed 2.780s CPU time. 2024-05-06T13:06:33.406 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 systemd[1]: Starting Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:33.857 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:33 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2618230384' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]: dispatch 2024-05-06T13:06:33.857 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:33 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]: dispatch 2024-05-06T13:06:33.857 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:33 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2618230384' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]: dispatch 2024-05-06T13:06:33.857 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:33 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]: dispatch 2024-05-06T13:06:34.081 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:33 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2618230384' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]: dispatch 2024-05-06T13:06:34.081 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:33 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]: dispatch 2024-05-06T13:06:34.081 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 podman[52449]: 2024-05-06 13:06:33.787946794 +0000 UTC m=+0.020949979 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-06T13:06:34.081 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:33 smithi186 podman[52449]: 2024-05-06 13:06:33.913209464 +0000 UTC m=+0.146212648 container create a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:06:34.300 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:06:34.515 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 podman[52449]: 2024-05-06 13:06:34.082119731 +0000 UTC m=+0.315122920 container init a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:06:34.515 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 podman[52449]: 2024-05-06 13:06:34.084682801 +0000 UTC m=+0.317685985 container start a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.087Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.088Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.088Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.088Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.088Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=arp 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-06T13:06:34.516 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-06T13:06:34.517 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-06T13:06:34.517 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-06T13:06:34.517 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=edac 2024-05-06T13:06:34.517 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-06T13:06:34.518 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=os 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-06T13:06:34.519 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-06T13:06:34.520 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=stat 2024-05-06T13:06:34.520 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-06T13:06:34.520 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-06T13:06:34.520 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-06T13:06:34.520 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=time 2024-05-06T13:06:34.520 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=uname 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b[52478]: ts=2024-05-06T13:06:34.089Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-06T13:06:34.521 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 bash[52449]: a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 2024-05-06T13:06:34.522 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:06:34 smithi186 systemd[1]: Started Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:34.982 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:06:34.982 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 starting - - - - 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 starting - - - - 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 starting - - - - 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (4m) 51s ago 4m 55.8M - 8.3.5 dad864ee21e9 e49b00504c24 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (3m) 40s ago 3m 53.0M - 3.5 e1d6a67b021e 30e6b3dea831 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283 starting - - - - 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:9283 running (11m) 40s ago 11m 465M - 17.2.0 e1d6a67b021e df15cc29df07 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (11m) 40s ago 11m 50.0M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (9m) 51s ago 9m 40.6M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (10m) 40s ago 10m 41.6M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 starting - - - - 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 starting - - - - 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (9m) 40s ago 9m 51.2M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:06:34.983 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (8m) 40s ago 8m 52.7M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (8m) 40s ago 8m 47.6M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (8m) 40s ago 8m 48.9M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (7m) 51s ago 7m 51.2M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (7m) 51s ago 7m 51.5M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (6m) 51s ago 6m 48.0M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (6m) 51s ago 6m 49.7M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 starting - - - - 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (4m) 40s ago 4m 71.5M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (4m) 51s ago 4m 69.9M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (3m) 40s ago 3m 71.7M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:06:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (3m) 51s ago 3m 69.6M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:06:35.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]': finished 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: osdmap e98: 8 total, 8 up, 8 in 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/866451193' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]: dispatch 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]: dispatch 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:34 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:06:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-06T13:06:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]': finished 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: osdmap e98: 8 total, 8 up, 8 in 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/866451193' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]: dispatch 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]: dispatch 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/978664437"}]': finished 2024-05-06T13:06:35.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: osdmap e98: 8 total, 8 up, 8 in 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/866451193' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]: dispatch 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]: dispatch 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:35.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:34 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:06:35.390 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:06:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:06:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:06:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:06:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-05-06T13:06:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:06:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:06:35.392 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "", 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-05-06T13:06:35.735 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:06:35.736 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:06:36.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: Reconfiguring grafana.a (dependencies changed)... 2024-05-06T13:06:36.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-06T13:06:36.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: Reconfiguring daemon grafana.a on smithi186 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='client.25153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]': finished 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: osdmap e99: 8 total, 8 up, 8 in 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4196505919' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]: dispatch 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]: dispatch 2024-05-06T13:06:36.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:35 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3632396403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:06:36.157 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:06:36.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: Reconfiguring grafana.a (dependencies changed)... 2024-05-06T13:06:36.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-06T13:06:36.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:06:36.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: Reconfiguring daemon grafana.a on smithi186 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='client.25153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]': finished 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: osdmap e99: 8 total, 8 up, 8 in 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/4196505919' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]: dispatch 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]: dispatch 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3632396403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: Reconfiguring grafana.a (dependencies changed)... 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: Reconfiguring daemon grafana.a on smithi186 2024-05-06T13:06:36.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='client.25153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/1814467570"}]': finished 2024-05-06T13:06:36.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: osdmap e99: 8 total, 8 up, 8 in 2024-05-06T13:06:36.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/4196505919' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]: dispatch 2024-05-06T13:06:36.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]: dispatch 2024-05-06T13:06:36.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:35 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3632396403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:06:36.924 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.924 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:36.924 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: from='client.25183 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:36.924 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]': finished 2024-05-06T13:06:36.924 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: osdmap e100: 8 total, 8 up, 8 in 2024-05-06T13:06:36.924 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/200045769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:06:36.925 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/117065727' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]: dispatch 2024-05-06T13:06:36.925 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:36 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]: dispatch 2024-05-06T13:06:37.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: from='client.25183 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]': finished 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: osdmap e100: 8 total, 8 up, 8 in 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/200045769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/117065727' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]: dispatch 2024-05-06T13:06:37.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]: dispatch 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: from='client.25183 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/1814467570"}]': finished 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: osdmap e100: 8 total, 8 up, 8 in 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/200045769' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/117065727' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]: dispatch 2024-05-06T13:06:37.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:36 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]: dispatch 2024-05-06T13:06:37.265 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:36 smithi186 systemd[1]: Stopping Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:37.265 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:36 smithi186 bash[52650]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana.a" found: no such container 2024-05-06T13:06:37.265 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[41716]: t=2024-05-06T13:06:37+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-05-06T13:06:37.266 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 podman[52661]: 2024-05-06 13:06:37.086180008 +0000 UTC m=+0.123811396 container died e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, io.openshift.tags=base rhel8, io.k8s.display-name=Red Hat Universal Base Image 8, release=236.1648460182, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, build-date=2022-03-28T10:36:18.413762, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.24.2, io.openshift.expose-services=, name=ubi8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container, maintainer=Paul Cuzner , version=8.5, architecture=x86_64) 2024-05-06T13:06:37.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 podman[52661]: 2024-05-06 13:06:37.400159903 +0000 UTC m=+0.437791300 container cleanup e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, name=ubi8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.expose-services=, description=Ceph Grafana Container, release=236.1648460182, build-date=2022-03-28T10:36:18.413762, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.buildah.version=1.24.2, vcs-type=git, version=8.5, io.openshift.tags=base rhel8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-06T13:06:37.584 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 bash[52661]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a 2024-05-06T13:06:37.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 podman[52675]: 2024-05-06 13:06:37.584887721 +0000 UTC m=+0.494864971 container remove e49b00504c2433acd6f3b770e4cb16b6607343829ded4a8a7b4fbd4f279ac92f (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, io.openshift.expose-services=, maintainer=Paul Cuzner , release=236.1648460182, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, build-date=2022-03-28T10:36:18.413762, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, name=ubi8, vendor=Red Hat, Inc., version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8) 2024-05-06T13:06:37.835 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 bash[52690]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana.a" found: no such container 2024-05-06T13:06:37.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-06T13:06:37.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 systemd[1]: Stopped Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:37.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@grafana.a.service: Consumed 2.424s CPU time. 2024-05-06T13:06:37.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 systemd[1]: Starting Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:37.836 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 podman[52760]: 2024-05-06 13:06:37.736422648 +0000 UTC m=+0.017321025 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-05-06T13:06:38.089 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:37 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]': finished 2024-05-06T13:06:38.089 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:37 smithi186 ceph-mon[23420]: osdmap e101: 8 total, 8 up, 8 in 2024-05-06T13:06:38.089 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:37 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3513768042' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]: dispatch 2024-05-06T13:06:38.089 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:37 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]: dispatch 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:37 smithi186 podman[52760]: 2024-05-06 13:06:37.835727757 +0000 UTC m=+0.116626133 container create d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, maintainer=Paul Cuzner , architecture=x86_64, io.openshift.tags=base rhel8, description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, name=ubi8, build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, version=8.5, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.component=ubi8-container, release=236.1648460182, io.buildah.version=1.24.2, vcs-type=git) 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 podman[52760]: 2024-05-06 13:06:38.021477031 +0000 UTC m=+0.302375409 container init d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, maintainer=Paul Cuzner , architecture=x86_64, vendor=Red Hat, Inc., description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, version=8.5, io.openshift.expose-services=, release=236.1648460182, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.24.2, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.tags=base rhel8) 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 podman[52760]: 2024-05-06 13:06:38.024171944 +0000 UTC m=+0.305070328 container start d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, release=236.1648460182, architecture=x86_64, io.openshift.tags=base rhel8, build-date=2022-03-28T10:36:18.413762, io.openshift.expose-services=, vendor=Red Hat, Inc., description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, vcs-type=git, name=ubi8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.24.2, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Paul Cuzner , com.redhat.component=ubi8-container, version=8.5) 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-05-06T13:06:38.090 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="App mode production" logger=settings 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=567.629µs 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 bash[52760]: d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 systemd[1]: Started Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:38.091 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-05-06T13:06:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]': finished 2024-05-06T13:06:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[22420]: osdmap e101: 8 total, 8 up, 8 in 2024-05-06T13:06:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3513768042' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]: dispatch 2024-05-06T13:06:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]: dispatch 2024-05-06T13:06:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3883601318"}]': finished 2024-05-06T13:06:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[27395]: osdmap e101: 8 total, 8 up, 8 in 2024-05-06T13:06:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3513768042' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]: dispatch 2024-05-06T13:06:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:37 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]: dispatch 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="deleted datasource based on configuration" logger=provisioning.datasources name=Dashboard1 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Loki uid=P8E80F9AEF21F6940 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-05-06T13:06:38.421 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:06:38+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STOPPING 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STOPPED 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STARTING 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Serving on http://:::9283 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STARTED 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STOPPING 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:06:38.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STOPPED 2024-05-06T13:06:38.423 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STARTING 2024-05-06T13:06:38.423 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Serving on http://:::9283 2024-05-06T13:06:38.423 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STARTED 2024-05-06T13:06:38.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STOPPING 2024-05-06T13:06:38.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:06:38.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STOPPED 2024-05-06T13:06:38.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STARTING 2024-05-06T13:06:38.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Serving on http://:::9283 2024-05-06T13:06:38.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:06:38] ENGINE Bus STARTED 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]': finished 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: osdmap e102: 8 total, 8 up, 8 in 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.095 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi186:3000"}]: dispatch 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2269737498' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2066961488"}]: dispatch 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]': finished 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: osdmap e102: 8 total, 8 up, 8 in 2024-05-06T13:06:39.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi186:3000"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:06:39.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:38 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2269737498' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2066961488"}]: dispatch 2024-05-06T13:06:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/457828510"}]': finished 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: osdmap e102: 8 total, 8 up, 8 in 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi186:3000"}]: dispatch 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:06:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:38 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2269737498' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2066961488"}]: dispatch 2024-05-06T13:06:40.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:06:40.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T13:06:40.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi186:3000"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2269737498' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2066961488"}]': finished 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: osdmap e103: 8 total, 8 up, 8 in 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1963708216' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:06:40.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi186:3000"}]: dispatch 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2269737498' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2066961488"}]': finished 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: osdmap e103: 8 total, 8 up, 8 in 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1963708216' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]: dispatch 2024-05-06T13:06:40.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:39 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]: dispatch 2024-05-06T13:06:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-06T13:06:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-05-06T13:06:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:06:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:06:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-06T13:06:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi186:3000"}]: dispatch 2024-05-06T13:06:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-06T13:06:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2269737498' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2066961488"}]': finished 2024-05-06T13:06:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: osdmap e103: 8 total, 8 up, 8 in 2024-05-06T13:06:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1963708216' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]: dispatch 2024-05-06T13:06:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:39 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]: dispatch 2024-05-06T13:06:41.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:41.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:41.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]': finished 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[22420]: osdmap e104: 8 total, 8 up, 8 in 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:06:41.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:41.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]': finished 2024-05-06T13:06:41.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:40 smithi016 ceph-mon[27395]: osdmap e104: 8 total, 8 up, 8 in 2024-05-06T13:06:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:06:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:06:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:06:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1751854629"}]': finished 2024-05-06T13:06:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:40 smithi186 ceph-mon[23420]: osdmap e104: 8 total, 8 up, 8 in 2024-05-06T13:06:42.102 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:41 smithi016 systemd[1]: Stopping Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:42.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:41 smithi016 ceph-mon[22420]: Upgrade: Updating mgr.y 2024-05-06T13:06:42.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:41 smithi016 ceph-mon[22420]: Deploying daemon mgr.y on smithi016 2024-05-06T13:06:42.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:41 smithi016 ceph-mon[27395]: Upgrade: Updating mgr.y 2024-05-06T13:06:42.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:41 smithi016 ceph-mon[27395]: Deploying daemon mgr.y on smithi016 2024-05-06T13:06:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:41 smithi186 ceph-mon[23420]: Upgrade: Updating mgr.y 2024-05-06T13:06:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:41 smithi186 ceph-mon[23420]: Deploying daemon mgr.y on smithi016 2024-05-06T13:06:42.387 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 podman[63093]: 2024-05-06 13:06:42.102839036 +0000 UTC m=+0.161411889 container died df15cc29df076ea1e95c4728064d34600d1722b804dcb5c27d56fa7a26e1d195 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, io.openshift.tags=base centos centos-stream, distribution-scope=public, vcs-type=git, release=754, name=centos-stream, version=8, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD) 2024-05-06T13:06:42.664 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 podman[63093]: 2024-05-06 13:06:42.387979284 +0000 UTC m=+0.446552125 container cleanup df15cc29df076ea1e95c4728064d34600d1722b804dcb5c27d56fa7a26e1d195 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, io.openshift.expose-services=, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., release=754, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, vcs-type=git, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, architecture=x86_64, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-05-06T13:06:42.664 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 bash[63093]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y 2024-05-06T13:06:42.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:42 smithi016 ceph-mon[22420]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:42.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:42 smithi016 ceph-mon[27395]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:42.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 podman[63107]: 2024-05-06 13:06:42.664612229 +0000 UTC m=+0.562157692 container remove df15cc29df076ea1e95c4728064d34600d1722b804dcb5c27d56fa7a26e1d195 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, name=centos-stream, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, io.openshift.expose-services=, io.buildah.version=1.19.8, GIT_CLEAN=True, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, release=754, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-05-06T13:06:42.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:06:42.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-05-06T13:06:42.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 systemd[1]: Stopped Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:42.924 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:42 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Consumed 1min 9.919s CPU time. 2024-05-06T13:06:43.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:42 smithi186 ceph-mon[23420]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:43.250 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 systemd[1]: Starting Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:06:43.545 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 podman[63234]: 2024-05-06 13:06:43.154126909 +0000 UTC m=+0.018976585 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:06:43.545 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 podman[63234]: 2024-05-06 13:06:43.27381776 +0000 UTC m=+0.138667435 container create 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux ) 2024-05-06T13:06:43.885 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 podman[63234]: 2024-05-06 13:06:43.543793327 +0000 UTC m=+0.408643003 container init 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-06T13:06:43.886 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 podman[63234]: 2024-05-06 13:06:43.546861541 +0000 UTC m=+0.411711216 container start 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:06:43.886 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mgr[63253]: -- 172.21.15.16:0/1386999697 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e7f8325a0 con 0x556e7f806c00 2024-05-06T13:06:43.886 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 bash[63234]: 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce 2024-05-06T13:06:43.886 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 systemd[1]: Started Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:06:43.886 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:43.705+0000 7f46dc41a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='client.25126 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:44.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:43 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:44.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:43 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:43.900+0000 7f46dc41a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:06:44.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:44.008+0000 7f46dc41a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='client.25126 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='client.25126 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:44.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:44.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:44.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:44.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:44.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:43 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:44.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:44.333+0000 7f46dc41a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:06:44.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:44.423+0000 7f46dc41a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:06:44.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:44] "GET /metrics HTTP/1.1" 200 38143 "" "Prometheus/2.33.4" 2024-05-06T13:06:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:44 smithi016 ceph-mon[22420]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:06:45.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:44 smithi016 ceph-mon[27395]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:06:45.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:44 smithi186 ceph-mon[23420]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:06:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:45 smithi186 ceph-mon[23420]: Deploying daemon agent.smithi186 on smithi186 2024-05-06T13:06:46.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:45 smithi016 ceph-mon[22420]: Deploying daemon agent.smithi186 on smithi186 2024-05-06T13:06:46.113 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:45.742+0000 7f46dc41a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:06:46.113 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:45 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:45.928+0000 7f46dc41a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:06:46.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:45 smithi016 ceph-mon[27395]: Deploying daemon agent.smithi186 on smithi186 2024-05-06T13:06:46.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:46.112+0000 7f46dc41a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:06:46.754 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:46.458+0000 7f46dc41a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:06:46.755 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:46.583+0000 7f46dc41a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:06:47.013 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[22420]: Deploying daemon agent.smithi016 on smithi016 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[22420]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 715 B/s rd, 0 op/s 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:46 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:46.801+0000 7f46dc41a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[27395]: Deploying daemon agent.smithi016 on smithi016 2024-05-06T13:06:47.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[27395]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 715 B/s rd, 0 op/s 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:46 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:46 smithi186 ceph-mon[23420]: Deploying daemon agent.smithi016 on smithi016 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:46 smithi186 ceph-mon[23420]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 715 B/s rd, 0 op/s 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:46 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:46 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:46 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:47.346 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:47 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:47.012+0000 7f46dc41a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:06:48.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:47 smithi186 ceph-mon[23420]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:06:48.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:47 smithi016 ceph-mon[27395]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:06:48.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:47 smithi016 ceph-mon[22420]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:06:48.105 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:47 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:47.678+0000 7f46dc41a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:06:48.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:48.133+0000 7f46dc41a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:06:48.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:48.244+0000 7f46dc41a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:06:48.749 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:48.461+0000 7f46dc41a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:06:48.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:48.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:06:49.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:49.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:49 smithi186 ceph-mon[23420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:06:49.297 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.036+0000 7f46dc41a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.147+0000 7f46dc41a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:49.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[22420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:49.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:49 smithi016 ceph-mon[27395]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:06:49.589 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.423+0000 7f46dc41a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:06:49.859 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.588+0000 7f46dc41a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:06:49.860 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.721+0000 7f46dc41a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:06:50.132 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.859+0000 7f46dc41a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:06:50.133 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:49.971+0000 7f46dc41a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:06:50.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:50 smithi016 ceph-mon[22420]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:06:50.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:50 smithi016 ceph-mon[27395]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:06:50.689 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:50 smithi186 ceph-mon[23420]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:06:51.096 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:50 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:50.860+0000 7f46dc41a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:06:51.096 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:51.096+0000 7f46dc41a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:06:51.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:51] ENGINE Bus STARTING 2024-05-06T13:06:51.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: CherryPy Checker: 2024-05-06T13:06:51.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: The Application mounted at '' has an empty config. 2024-05-06T13:06:51.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:06:51.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:51] ENGINE Serving on http://:::9283 2024-05-06T13:06:51.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:51] ENGINE Bus STARTED 2024-05-06T13:06:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:51 smithi186 ceph-mon[23420]: Standby manager daemon y restarted 2024-05-06T13:06:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:51 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:06:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:51 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:06:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:51 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:51 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:06:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:51 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[22420]: Standby manager daemon y restarted 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[22420]: Standby manager daemon y started 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[27395]: Standby manager daemon y restarted 2024-05-06T13:06:51.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:06:51.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:06:51.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:06:51.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:06:51.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:51 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:06:52.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[22420]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 965 B/s rd, 0 op/s 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[22420]: mgrmap e27: x(active, since 50s), standbys: y 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[27395]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 965 B/s rd, 0 op/s 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[27395]: mgrmap e27: x(active, since 50s), standbys: y 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:52.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:52 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:52.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:52 smithi186 ceph-mon[23420]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 965 B/s rd, 0 op/s 2024-05-06T13:06:52.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:52 smithi186 ceph-mon[23420]: mgrmap e27: x(active, since 50s), standbys: y 2024-05-06T13:06:52.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:52 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:52.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:52 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:53.637 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:53 smithi016 ceph-mon[22420]: from='client.25126 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:53.637 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:53 smithi016 ceph-mon[27395]: from='client.25126 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:53.709 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:53 smithi186 ceph-mon[23420]: from='client.25126 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:06:54.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:54 smithi186 ceph-mon[23420]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:54.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ::ffff:172.21.15.186 - - [06/May/2024:13:06:54] "GET /metrics HTTP/1.1" 200 38152 "" "Prometheus/2.33.4" 2024-05-06T13:06:54.767 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:54 smithi016 ceph-mon[22420]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:54.767 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:54 smithi016 ceph-mon[27395]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:06:55.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:54.893+0000 7fd339777700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Creating ceph-iscsi config... 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Traceback (most recent call last): 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return _run_code(code, main_globals, None, 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: exec(code, run_globals) 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:55.266 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:55.267 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Traceback (most recent call last): 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return future.result(timeout) 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return self.__get_result() 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: raise self._exception 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: use_current_daemon_image=reconfig, 2024-05-06T13:06:55.268 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Creating ceph-iscsi config... 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: Traceback (most recent call last): 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: return _run_code(code, main_globals, None, 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: exec(code, run_globals) 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:06:55.269 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:06:55.270 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:06:56.154 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:55.792+0000 7fd3a7128700 -1 mgr handle_mgr_map I was active but no longer am 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ignoring --setuser ceph since I am not root 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ignoring --setgroup ceph since I am not root 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mgr[48952]: -- 172.21.15.186:0/4094345790 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633912465a0 con 0x56339121ac00 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:55.971+0000 7f410e00a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:56.154+0000 7f410e00a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: osdmap e105: 8 total, 8 up, 8 in 2024-05-06T13:06:56.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: Standby manager daemon x started 2024-05-06T13:06:56.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:55 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:55] ENGINE Bus STOPPING 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:55] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:55] ENGINE Bus STOPPED 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:55] ENGINE Bus STARTING 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:56] ENGINE Serving on http://:::9283 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:06:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:06:56] ENGINE Bus STARTED 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: osdmap e105: 8 total, 8 up, 8 in 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: Standby manager daemon x started 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:06:56.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 172.21.15.186:0/3294876764' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-06T13:06:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-06T13:06:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: osdmap e105: 8 total, 8 up, 8 in 2024-05-06T13:06:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: Standby manager daemon x started 2024-05-06T13:06:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:55 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' 2024-05-06T13:06:56.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:56.257+0000 7f410e00a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:06:56.838 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:56.582+0000 7f410e00a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:06:56.838 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:56.675+0000 7f410e00a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:06:56.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.34937 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-05-06T13:06:56.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: mgrmap e28: y(active, starting, since 0.88856s), standbys: x 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:06:56.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: Manager daemon y is now available 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:56.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: [06/May/2024:13:06:56] ENGINE Bus STARTING 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: [06/May/2024:13:06:56] ENGINE Serving on http://172.21.15.16:8765 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: [06/May/2024:13:06:56] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:06:56.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:56 smithi186 ceph-mon[23420]: [06/May/2024:13:06:56] ENGINE Bus STARTED 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.34937 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: mgrmap e28: y(active, starting, since 0.88856s), standbys: x 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:06:57.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: Manager daemon y is now available 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:57.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.34937 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: mgrmap e28: y(active, starting, since 0.88856s), standbys: x 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:06:57.076 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: Manager daemon y is now available 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:57.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: [06/May/2024:13:06:56] ENGINE Bus STARTING 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: [06/May/2024:13:06:56] ENGINE Serving on http://172.21.15.16:8765 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: [06/May/2024:13:06:56] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[22420]: [06/May/2024:13:06:56] ENGINE Bus STARTED 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:06:57.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: [06/May/2024:13:06:56] ENGINE Bus STARTING 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: [06/May/2024:13:06:56] ENGINE Serving on http://172.21.15.16:8765 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: [06/May/2024:13:06:56] ENGINE Serving on https://172.21.15.16:7150 2024-05-06T13:06:57.080 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:56 smithi016 ceph-mon[27395]: [06/May/2024:13:06:56] ENGINE Bus STARTED 2024-05-06T13:06:58.132 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:57.950+0000 7f410e00a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:06:58.132 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:58.132 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: mgrmap e29: y(active, since 1.89823s), standbys: x 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.133 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:58.134 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:57 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:58.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:58.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:58.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: mgrmap e29: y(active, since 1.89823s), standbys: x 2024-05-06T13:06:58.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:58.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:06:58.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: mgrmap e29: y(active, since 1.89823s), standbys: x 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:58.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:58.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:57 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:06:58.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:58.151+0000 7f410e00a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:06:58.422 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:58.334+0000 7f410e00a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:06:58.702 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:58.662+0000 7f410e00a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:06:58.702 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:06:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:06:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:58.767+0000 7f410e00a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: mgrmap e30: y(active, since 2s), standbys: x 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:58.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:58 smithi186 ceph-mon[23420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: mgrmap e30: y(active, since 2s), standbys: x 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[22420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: mgrmap e30: y(active, since 2s), standbys: x 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:06:59.143 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:58 smithi016 ceph-mon[27395]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:06:59.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:58.983+0000 7f410e00a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:06:59.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:59.207+0000 7f410e00a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:07:00.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.073 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.074 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:06:59 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.263 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:06:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:06:59.912+0000 7f410e00a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:07:00.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:06:59 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:00.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:00.395+0000 7f410e00a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:07:00.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:00.494+0000 7f410e00a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:07:00.991 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:00.706+0000 7f410e00a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:07:01.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: mgrmap e31: y(active, since 5s), standbys: x 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:01 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.374 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: mgrmap e31: y(active, since 5s), standbys: x 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.375 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: mgrmap e31: y(active, since 5s), standbys: x 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:01.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:01 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:01.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:01.264+0000 7f410e00a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:07:01.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:01.360+0000 7f410e00a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:07:01.899 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:01.617+0000 7f410e00a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:07:01.899 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:01.755+0000 7f410e00a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:07:01.900 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:01.855+0000 7f410e00a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:07:02.174 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:01.976+0000 7f410e00a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:07:02.174 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:02.073+0000 7f410e00a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:07:02.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:02 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:02 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:02 smithi186 ceph-mon[23420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:02.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:02 smithi186 ceph-mon[23420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:02.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:02 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[22420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:02.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[22420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:02.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:02.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[27395]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:02.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[27395]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:02.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:02 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:03.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:02.921+0000 7f410e00a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:07:03.299 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:03 smithi186 ceph-mon[23420]: Standby manager daemon x restarted 2024-05-06T13:07:03.299 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:03 smithi186 ceph-mon[23420]: Standby manager daemon x started 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:03 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:03 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:03 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:03 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:03.155+0000 7f410e00a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:07:03] ENGINE Bus STARTING 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: CherryPy Checker: 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: The Application mounted at '' has an empty config. 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:07:03] ENGINE Serving on http://:::9283 2024-05-06T13:07:03.300 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: [06/May/2024:13:07:03] ENGINE Bus STARTED 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[22420]: Standby manager daemon x restarted 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[22420]: Standby manager daemon x started 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[27395]: Standby manager daemon x restarted 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[27395]: Standby manager daemon x started 2024-05-06T13:07:03.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:07:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:07:03.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:03 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1211206312' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 0 B/s wr, 37 op/s 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: mgrmap e32: y(active, since 8s), standbys: x 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 0 B/s wr, 35 op/s 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 0 B/s wr, 38 op/s 2024-05-06T13:07:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:04 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 0 B/s wr, 37 op/s 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: mgrmap e32: y(active, since 8s), standbys: x 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 0 B/s wr, 35 op/s 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 0 B/s wr, 38 op/s 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 0 B/s wr, 37 op/s 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: mgrmap e32: y(active, since 8s), standbys: x 2024-05-06T13:07:04.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 0 B/s wr, 35 op/s 2024-05-06T13:07:04.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 0 B/s wr, 38 op/s 2024-05-06T13:07:04.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:04 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:04.903 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[48948]: ::ffff:172.21.15.186 - - [06/May/2024:13:07:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:07:04.904 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 systemd[1]: Stopping Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:07:04.904 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 bash[55942]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:07:05.154 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.903Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.903Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.903Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.903Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.903Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.904Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.904Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.904Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.904Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.904Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.904Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[51869]: ts=2024-05-06T13:07:04.905Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-06T13:07:05.155 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:04 smithi186 podman[55955]: 2024-05-06 13:07:04.914161752 +0000 UTC m=+0.125243395 container died 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:05.465 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 podman[55955]: 2024-05-06 13:07:05.237042773 +0000 UTC m=+0.448124423 container cleanup 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:05.465 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 bash[55955]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a 2024-05-06T13:07:05.465 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 bash[55983]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:07:05.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 podman[55969]: 2024-05-06 13:07:05.465566899 +0000 UTC m=+0.552824063 container remove 22e50434e2017e7048dc8d2dc5d2cc9bcd4b9bee39aa0df8b750621897c4c820 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:05.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-06T13:07:05.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 systemd[1]: Stopped Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:07:05.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 systemd[1]: Starting Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:07:05.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 podman[56053]: 2024-05-06 13:07:05.60440573 +0000 UTC m=+0.019066937 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-06T13:07:05.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 podman[56053]: 2024-05-06 13:07:05.708012014 +0000 UTC m=+0.122673216 container create 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:06.170 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 podman[56053]: 2024-05-06 13:07:05.935426243 +0000 UTC m=+0.350087446 container init 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:06.170 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 podman[56053]: 2024-05-06 13:07:05.937912914 +0000 UTC m=+0.352574110 container start 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.961Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.961Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.961Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.961Z caller=main.go:518 level=info host_details="(Linux 5.14.0-437.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 x86_64 smithi186 (none))" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.961Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.961Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.963Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.963Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.965Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.966Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.966Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.562µs 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.966Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-06T13:07:06.171 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:05.968Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-05-06T13:07:06.172 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 bash[56053]: 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 2024-05-06T13:07:06.172 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 systemd[1]: Started Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:07:06.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:06] ENGINE Bus STOPPING 2024-05-06T13:07:06.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:06] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:07:06.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:06] ENGINE Bus STOPPED 2024-05-06T13:07:06.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:06] ENGINE Bus STARTING 2024-05-06T13:07:06.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:06] ENGINE Serving on http://:::9283 2024-05-06T13:07:06.422 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:06 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:06] ENGINE Bus STARTED 2024-05-06T13:07:06.423 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.419Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-05-06T13:07:06.531 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:07:06.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:06.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T13:07:06.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:06 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:06.720 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:06 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.461Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.461Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.461Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=32.556µs wal_replay_duration=494.854023ms total_replay_duration=494.906202ms 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.464Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.464Z caller=main.go:947 level=info msg="TSDB started" 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.465Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.485Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.860009ms db_storage=902ns remote_storage=1.131µs web_handler=332ns query_engine=715ns scrape=231.505µs scrape_sd=93.339µs notify=17.612µs notify_sd=16.668µs rules=20.253504ms 2024-05-06T13:07:06.721 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:06.485Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-06T13:07:07.205 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:07:07.205 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 3s ago 10m - - 2024-05-06T13:07:07.205 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 6s ago 10m - - 2024-05-06T13:07:07.205 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (51s) 3s ago 5m 17.0M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:07:07.205 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (29s) 6s ago 5m 43.5M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:07:07.205 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 unknown 3s ago 4m - - 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283 running (73s) 6s ago 10m 269M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 707ac8034f02 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (24s) 3s ago 11m 491M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2910acc50571 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (11m) 3s ago 11m 56.5M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (10m) 6s ago 10m 52.2M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (10m) 3s ago 10m 50.2M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (57s) 3s ago 6m 8090k - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (33s) 6s ago 6m 8736k - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (9m) 3s ago 9m 51.7M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (9m) 3s ago 9m 54.2M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (9m) 3s ago 9m 48.7M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (8m) 3s ago 8m 50.3M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (8m) 6s ago 8m 53.0M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:07:07.206 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (7m) 6s ago 7m 52.0M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (7m) 6s ago 7m 49.7M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (7m) 6s ago 7m 51.7M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 starting - - - - 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (4m) 3s ago 4m 73.3M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (4m) 6s ago 4m 71.6M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (4m) 3s ago 4m 73.4M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:07:07.207 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (4m) 6s ago 4m 71.6M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:07:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:07:07.618 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:07:07.618 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:07.618 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T13:07:07.618 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[22420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:07:07.618 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[22420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/998802778' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[22420]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[27395]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[27395]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/998802778' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:07:07.619 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:07 smithi016 ceph-mon[27395]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:07 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:07 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186.front.sepia.ceph.com:9095"}]: dispatch 2024-05-06T13:07:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:07 smithi186 ceph-mon[23420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:07:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:07 smithi186 ceph-mon[23420]: Upgrade: Need to upgrade myself (mgr.y) 2024-05-06T13:07:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:07 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/998802778' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:07:07.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:07 smithi186 ceph-mon[23420]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:07.958 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mgr daemons", 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:07:07.959 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:07:08.369 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-05-06T13:07:08.369 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-05-06T13:07:08.369 INFO:teuthology.orchestra.run.smithi016.stdout: daemon iscsi.foo.smithi016.oxwhiv on smithi016 is in unknown state 2024-05-06T13:07:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='client.25285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 19 op/s 2024-05-06T13:07:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3093218559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:07:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:07:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:07:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1122135619' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:07:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:08 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:08.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='client.25285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:08.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 19 op/s 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3093218559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1122135619' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='client.25285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:08.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 19 op/s 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3093218559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1122135619' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:08.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:08 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:09.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:09 smithi186 ceph-mon[23420]: Upgrade: Updating mgr.x 2024-05-06T13:07:09.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:09 smithi186 ceph-mon[23420]: Deploying daemon mgr.x on smithi186 2024-05-06T13:07:09.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:09 smithi186 ceph-mon[23420]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:09.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:09 smithi186 ceph-mon[23420]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-05-06T13:07:09.641 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:09 smithi186 ceph-mon[23420]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2024-05-06T13:07:09.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[22420]: Upgrade: Updating mgr.x 2024-05-06T13:07:09.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[22420]: Deploying daemon mgr.x on smithi186 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[22420]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[22420]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[22420]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[27395]: Upgrade: Updating mgr.x 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[27395]: Deploying daemon mgr.x on smithi186 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[27395]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[27395]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-05-06T13:07:09.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:09 smithi016 ceph-mon[27395]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2024-05-06T13:07:09.941 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:09 smithi186 systemd[1]: Stopping Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:07:10.226 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:09 smithi186 podman[56495]: 2024-05-06 13:07:09.941879965 +0000 UTC m=+0.157738490 container died 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_BRANCH=HEAD) 2024-05-06T13:07:10.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 podman[56495]: 2024-05-06 13:07:10.227176232 +0000 UTC m=+0.443034740 container cleanup 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-06T13:07:10.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 bash[56495]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x 2024-05-06T13:07:10.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 podman[56509]: 2024-05-06 13:07:10.470382169 +0000 UTC m=+0.531702202 container remove 707ac8034f027946bf37909cc456b4cf9ea4a845b9212133cda23ec1a8e28b6a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-70ce953, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-06T13:07:10.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:07:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-05-06T13:07:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 systemd[1]: Stopped Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:07:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service: Consumed 29.207s CPU time. 2024-05-06T13:07:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:10 smithi186 systemd[1]: Starting Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:07:11.298 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 podman[56640]: 2024-05-06 13:07:10.929878857 +0000 UTC m=+0.018036432 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:07:11.298 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 podman[56640]: 2024-05-06 13:07:11.071693566 +0000 UTC m=+0.159851117 container create de55246538ea3506681a9eb79dc54745d36c6aefaf3352832c3d9e5281206047 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953) 2024-05-06T13:07:11.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:11 smithi186 ceph-mon[23420]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 143 B/s rd, 0 op/s 2024-05-06T13:07:11.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:11 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:11.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:11 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 podman[56640]: 2024-05-06 13:07:11.299368316 +0000 UTC m=+0.387525865 container init de55246538ea3506681a9eb79dc54745d36c6aefaf3352832c3d9e5281206047 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 podman[56640]: 2024-05-06 13:07:11.302039797 +0000 UTC m=+0.390197345 container start de55246538ea3506681a9eb79dc54745d36c6aefaf3352832c3d9e5281206047 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 ceph-mgr[56659]: -- 172.21.15.186:0/3759642308 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630aed2e5a0 con 0x5630aed02c00 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 bash[56640]: de55246538ea3506681a9eb79dc54745d36c6aefaf3352832c3d9e5281206047 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 systemd[1]: Started Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:11.464+0000 7fe6cd775200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:07:11.657 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:11.655+0000 7fe6cd775200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:07:11.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:11 smithi016 ceph-mon[22420]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 143 B/s rd, 0 op/s 2024-05-06T13:07:11.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:11 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:11.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:11 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:11.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:11 smithi016 ceph-mon[27395]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 143 B/s rd, 0 op/s 2024-05-06T13:07:11.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:11 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:11.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:11 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:12.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:11.760+0000 7fe6cd775200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:07:12.480 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:12.073+0000 7fe6cd775200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:07:12.481 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:12.158+0000 7fe6cd775200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:07:12.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 124 B/s rd, 0 op/s 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 163 B/s rd, 0 op/s 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:07:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:12 smithi186 ceph-mon[23420]: osdmap e106: 8 total, 8 up, 8 in 2024-05-06T13:07:12.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:12.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 124 B/s rd, 0 op/s 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 163 B/s rd, 0 op/s 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[22420]: osdmap e106: 8 total, 8 up, 8 in 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: ignoring --setuser ceph since I am not root 2024-05-06T13:07:12.890 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: ignoring --setgroup ceph since I am not root 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mgr[63253]: -- 172.21.15.16:0/3830995284 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da6c1a25a0 con 0x55da6c176800 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:12.696+0000 7f17c6127200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:12.888+0000 7f17c6127200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 124 B/s rd, 0 op/s 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 163 B/s rd, 0 op/s 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:12.891 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:12.892 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 172.21.15.16:0/767991595' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:07:12.892 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-05-06T13:07:12.892 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:12 smithi016 ceph-mon[27395]: osdmap e106: 8 total, 8 up, 8 in 2024-05-06T13:07:13.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:12.994+0000 7f17c6127200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:07:13.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:13.333+0000 7f17c6127200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:07:13.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:13.423+0000 7f17c6127200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:07:13.673 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:07:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=warn ts=2024-05-06T13:07:13.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi186:8443/api/prometheus_receiver\": dial tcp 172.21.15.186:8443: connect: connection refused" 2024-05-06T13:07:13.673 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:07:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=warn ts=2024-05-06T13:07:13.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi016.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.16:8443: connect: connection refused" 2024-05-06T13:07:13.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:13 smithi016 ceph-mon[22420]: from='mgr.25219 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-05-06T13:07:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:13 smithi016 ceph-mon[22420]: mgrmap e33: x(active, starting, since 0.861732s) 2024-05-06T13:07:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:13 smithi016 ceph-mon[27395]: from='mgr.25219 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-05-06T13:07:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:13 smithi016 ceph-mon[27395]: mgrmap e33: x(active, starting, since 0.861732s) 2024-05-06T13:07:13.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:13 smithi186 ceph-mon[23420]: from='mgr.25219 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-05-06T13:07:13.674 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:13 smithi186 ceph-mon[23420]: mgrmap e33: x(active, starting, since 0.861732s) 2024-05-06T13:07:13.675 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:13.364+0000 7fe6cd775200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:07:13.675 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:13.541+0000 7fe6cd775200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:07:14.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:13.714+0000 7fe6cd775200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:07:14.328 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:14.016+0000 7fe6cd775200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:07:14.328 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:14.113+0000 7fe6cd775200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:07:14.685 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:14.327+0000 7fe6cd775200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:07:14.686 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:14.530+0000 7fe6cd775200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:07:15.050 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:14.693+0000 7f17c6127200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:07:15.050 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:14.871+0000 7f17c6127200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:07:15.051 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:15.049+0000 7f17c6127200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:07:15.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:15.192+0000 7fe6cd775200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:07:15.666 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:15.353+0000 7f17c6127200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:07:15.666 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:15.453+0000 7f17c6127200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:07:15.666 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:15.665+0000 7f17c6127200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:07:15.902 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:15.642+0000 7fe6cd775200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:07:15.902 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:15.745+0000 7fe6cd775200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:07:15.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:15.869+0000 7f17c6127200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:07:16.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:15.959+0000 7fe6cd775200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:07:16.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:16.489+0000 7fe6cd775200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:07:16.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:16.584+0000 7fe6cd775200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:07:16.887 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:16.558+0000 7f17c6127200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:07:17.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:17.015+0000 7f17c6127200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:07:17.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:17.127+0000 7f17c6127200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:07:17.187 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:16.833+0000 7fe6cd775200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:07:17.187 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:16.970+0000 7fe6cd775200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:07:17.187 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:17.069+0000 7fe6cd775200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:07:17.187 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:17.186+0000 7fe6cd775200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:07:17.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:17.284+0000 7fe6cd775200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:07:17.651 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:17.346+0000 7f17c6127200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:07:18.319 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:17.932+0000 7f17c6127200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:07:18.319 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:18.040+0000 7f17c6127200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:07:18.319 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:18.318+0000 7f17c6127200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:07:18.395 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:18.106+0000 7fe6cd775200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:07:18.395 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:18.330+0000 7fe6cd775200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:07:18.395 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Bus STARTING 2024-05-06T13:07:18.583 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:18.476+0000 7f17c6127200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:07:18.583 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: Active manager daemon x restarted 2024-05-06T13:07:18.583 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: Activating manager daemon x 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: osdmap e107: 8 total, 8 up, 8 in 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: Active manager daemon x restarted 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: Activating manager daemon x 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: osdmap e107: 8 total, 8 up, 8 in 2024-05-06T13:07:18.584 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:18.585 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:07:18.585 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:18.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: Active manager daemon x restarted 2024-05-06T13:07:18.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: Activating manager daemon x 2024-05-06T13:07:18.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-06T13:07:18.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: osdmap e107: 8 total, 8 up, 8 in 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: CherryPy Checker: 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: The Application mounted at '' has an empty config. 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Serving on http://:::9283 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Bus STARTED 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Bus STOPPING 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:07:18.660 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Bus STOPPED 2024-05-06T13:07:18.661 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Bus STARTING 2024-05-06T13:07:18.661 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Serving on http://:::9283 2024-05-06T13:07:18.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:18.582+0000 7f17c6127200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:07:18.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:18.708+0000 7f17c6127200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:07:18.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:18.815+0000 7f17c6127200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:07:19.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:18] ENGINE Bus STARTED 2024-05-06T13:07:19.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:07:19.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: mgrmap e34: x(active, starting, since 0.0577403s) 2024-05-06T13:07:19.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:07:19.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:07:19.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: Manager daemon x is now available 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:19.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: [06/May/2024:13:07:18] ENGINE Bus STARTING 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: [06/May/2024:13:07:19] ENGINE Serving on https://172.21.15.186:7151 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.651 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:19.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:19.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:07:19.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:07:19.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: [06/May/2024:13:07:19] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:07:19.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:19 smithi186 ceph-mon[23420]: [06/May/2024:13:07:19] ENGINE Bus STARTED 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: mgrmap e34: x(active, starting, since 0.0577403s) 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:07:19.668 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: Manager daemon x is now available 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:07:19.669 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.670 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: [06/May/2024:13:07:18] ENGINE Bus STARTING 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: [06/May/2024:13:07:19] ENGINE Serving on https://172.21.15.186:7151 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: [06/May/2024:13:07:19] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:07:19.671 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[27395]: [06/May/2024:13:07:19] ENGINE Bus STARTED 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: mgrmap e34: x(active, starting, since 0.0577403s) 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:07:19.672 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: Manager daemon x is now available 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:07:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: [06/May/2024:13:07:18] ENGINE Bus STARTING 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: [06/May/2024:13:07:19] ENGINE Serving on https://172.21.15.186:7151 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:07:19.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: [06/May/2024:13:07:19] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:07:19.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:19 smithi016 ceph-mon[22420]: [06/May/2024:13:07:19] ENGINE Bus STARTED 2024-05-06T13:07:19.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:19.758+0000 7f17c6127200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:20.004+0000 7f17c6127200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:20] ENGINE Bus STARTING 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: CherryPy Checker: 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: The Application mounted at '' has an empty config. 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:20] ENGINE Serving on http://:::9283 2024-05-06T13:07:20.407 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: [06/May/2024:13:07:20] ENGINE Bus STARTED 2024-05-06T13:07:20.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: mgrmap e35: x(active, since 1.07137s) 2024-05-06T13:07:20.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='client.25258 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:20.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:20.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:07:20.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:07:20.408 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:07:20.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[27395]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: mgrmap e35: x(active, since 1.07137s) 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='client.25258 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:20.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Standby manager daemon y started 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:20.677 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-mon[22420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:07:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: mgrmap e35: x(active, since 1.07137s) 2024-05-06T13:07:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='client.25258 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:07:20.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1203434790' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:20.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:20 smithi186 ceph-mon[23420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:07:21.095 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:07:20 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:07:20.962Z caller=notify.go:735 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify success" attempts=6 2024-05-06T13:07:21.423 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:07:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:07:21.216Z caller=notify.go:735 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify success" attempts=6 2024-05-06T13:07:21.949 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:21 smithi016 ceph-mon[22420]: mgrmap e36: x(active, since 2s), standbys: y 2024-05-06T13:07:21.950 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:21 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:07:21.950 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:21 smithi016 ceph-mon[27395]: mgrmap e36: x(active, since 2s), standbys: y 2024-05-06T13:07:21.950 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:21 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:07:21.954 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:21 smithi186 ceph-mon[23420]: mgrmap e36: x(active, since 2s), standbys: y 2024-05-06T13:07:21.954 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:21 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:07:22.998 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:22 smithi186 ceph-mon[23420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:23.003 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:22 smithi016 ceph-mon[22420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:23.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:22 smithi016 ceph-mon[27395]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:23.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:23 smithi016 ceph-mon[22420]: mgrmap e37: x(active, since 4s), standbys: y 2024-05-06T13:07:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:23 smithi016 ceph-mon[27395]: mgrmap e37: x(active, since 4s), standbys: y 2024-05-06T13:07:24.000 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:23 smithi186 ceph-mon[23420]: mgrmap e37: x(active, since 4s), standbys: y 2024-05-06T13:07:24.772 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:24 smithi016 ceph-mon[22420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:24.772 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:24 smithi016 ceph-mon[27395]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:25.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:24 smithi186 ceph-mon[23420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:25.923 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:25 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:25.923 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:25 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:07:25.649+0000 7fe6533a7700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Creating ceph-iscsi config... 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Traceback (most recent call last): 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: return _run_code(code, main_globals, None, 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:25.924 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: exec(code, run_globals) 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:25.925 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Traceback (most recent call last): 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: return future.result(timeout) 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: return self.__get_result() 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: raise self._exception 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:07:25.926 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: use_current_daemon_image=reconfig, 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Creating ceph-iscsi config... 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: Traceback (most recent call last): 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: return _run_code(code, main_globals, None, 2024-05-06T13:07:25.927 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: exec(code, run_globals) 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:25.928 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:25.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:25 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:25.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:25 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:25.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:25 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:25.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:25 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:07:27.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:26 smithi186 ceph-mon[23420]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:27.015 INFO:journalctl@ceph.mon.b.smithi186.stdout: Creating ceph-iscsi config... 2024-05-06T13:07:27.015 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:27.015 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:27.015 INFO:journalctl@ceph.mon.b.smithi186.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: exec(code, run_globals) 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:27.016 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:07:27.017 INFO:journalctl@ceph.mon.b.smithi186.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: return future.result(timeout) 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: return self.__get_result() 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: raise self._exception 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: use_current_daemon_image=reconfig, 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:27.018 INFO:journalctl@ceph.mon.b.smithi186.stdout: Creating ceph-iscsi config... 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: exec(code, run_globals) 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:27.019 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:26 smithi186 ceph-mon[23420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-05-06T13:07:27.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:26 smithi016 ceph-mon[22420]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:07:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: return future.result(timeout) 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: return self.__get_result() 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: raise self._exception 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: use_current_daemon_image=reconfig, 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:07:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.a.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.a.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.a.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:26 smithi016 ceph-mon[22420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:26 smithi016 ceph-mon[27395]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2455, in _daemon_action 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 777, in wait_async 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: return future.result(timeout) 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: return self.__get_result() 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: raise self._exception 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-06T13:07:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout: use_current_daemon_image=reconfig, 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: Creating ceph-iscsi config... 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: Non-zero exit code 1 from systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: Traceback (most recent call last): 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:07:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1123, in deploy_daemon 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: RuntimeError: Failed command: systemctl restart ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:07:27.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:26 smithi016 ceph-mon[27395]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 15 op/s 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 15 op/s 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:07:28.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:07:28.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 15 op/s 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 15 op/s 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: Reconfiguring daemon prometheus.a on smithi186 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 15 op/s 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 0 B/s wr, 15 op/s 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:29.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:07:28 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[63249]: ::ffff:172.21.15.186 - - [06/May/2024:13:07:28] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-06T13:07:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:29 smithi186 ceph-mon[23420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:07:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:29 smithi186 ceph-mon[23420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-05-06T13:07:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:29 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:29 smithi016 ceph-mon[22420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:07:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:29 smithi016 ceph-mon[22420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-05-06T13:07:29.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:29 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:29.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:29 smithi016 ceph-mon[27395]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:07:29.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:29 smithi016 ceph-mon[27395]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-05-06T13:07:29.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:29 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.381 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 systemd[1]: Stopping Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:07:31.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:31 smithi186 ceph-mon[23420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-05-06T13:07:31.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:31 smithi186 ceph-mon[23420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:31.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:31 smithi186 ceph-mon[23420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:31.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[22420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-05-06T13:07:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[22420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[22420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[27395]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[27395]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[27395]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:31.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.381Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.381Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-06T13:07:31.716 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-06T13:07:31.717 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-06T13:07:31.717 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-06T13:07:31.717 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-06T13:07:31.717 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[56068]: ts=2024-05-06T13:07:31.382Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-06T13:07:31.717 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 podman[59121]: 2024-05-06 13:07:31.391939711 +0000 UTC m=+0.131912841 container died 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:32.007 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 podman[59121]: 2024-05-06 13:07:31.815038803 +0000 UTC m=+0.555011930 container cleanup 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:32.007 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 bash[59121]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a 2024-05-06T13:07:32.007 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:31 smithi186 bash[59147]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:07:32.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 podman[59135]: 2024-05-06 13:07:32.007883096 +0000 UTC m=+0.617110141 container remove 8210bbef0157ff558f94a24404a06a633976043ab5bfa959130feddda6c7d0b0 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:32.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-06T13:07:32.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 systemd[1]: Stopped Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:07:32.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 systemd[1]: Starting Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:07:32.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 podman[59220]: 2024-05-06 13:07:32.144246873 +0000 UTC m=+0.019041596 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-06T13:07:32.527 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 podman[59220]: 2024-05-06 13:07:32.267191746 +0000 UTC m=+0.141986512 container create 2679b06be93798e297e1cbc77ad5e46761480bc9567a61339d14712dc7f73c6b (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:32.808 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:32] ENGINE Bus STOPPING 2024-05-06T13:07:32.808 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:32] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:07:32.808 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:32] ENGINE Bus STOPPED 2024-05-06T13:07:32.808 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:32] ENGINE Bus STARTING 2024-05-06T13:07:32.808 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 podman[59220]: 2024-05-06 13:07:32.527848904 +0000 UTC m=+0.402643627 container init 2679b06be93798e297e1cbc77ad5e46761480bc9567a61339d14712dc7f73c6b (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:32.808 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 podman[59220]: 2024-05-06 13:07:32.53061573 +0000 UTC m=+0.405410453 container start 2679b06be93798e297e1cbc77ad5e46761480bc9567a61339d14712dc7f73c6b (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.553Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.553Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.553Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.553Z caller=main.go:518 level=info host_details="(Linux 5.14.0-437.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 x86_64 smithi186 (none))" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.553Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.553Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.555Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.555Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.557Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.559Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.559Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.488µs 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.559Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:32.560Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-05-06T13:07:32.809 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 bash[59220]: 2679b06be93798e297e1cbc77ad5e46761480bc9567a61339d14712dc7f73c6b 2024-05-06T13:07:32.810 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:32 smithi186 systemd[1]: Started Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:07:33.066 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.011Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-05-06T13:07:33.066 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:32] ENGINE Serving on http://:::9283 2024-05-06T13:07:33.066 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:07:32] ENGINE Bus STARTED 2024-05-06T13:07:33.401 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.066Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-05-06T13:07:33.401 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.068Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-05-06T13:07:33.401 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.068Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-05-06T13:07:33.402 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.068Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=37.338µs wal_replay_duration=509.62614ms total_replay_duration=509.676555ms 2024-05-06T13:07:33.402 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.072Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-06T13:07:33.402 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.072Z caller=main.go:947 level=info msg="TSDB started" 2024-05-06T13:07:33.402 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.072Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-06T13:07:33.402 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.097Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.742953ms db_storage=925ns remote_storage=1.38µs web_handler=307ns query_engine=784ns scrape=608.465µs scrape_sd=93.033µs notify=11.613µs notify_sd=10.492µs rules=23.67768ms 2024-05-06T13:07:33.402 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:33.097Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-06T13:07:33.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:33.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.402 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:33.403 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:33.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:33.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:33.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:33.507 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:33.507 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:07:33.508 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:07:33.509 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:33.510 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:33.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:33.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:33.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:07:33.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:34.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: Upgrade: Setting container_image for all mgr 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: Upgrade: Setting container_image for all mgr 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:07:34.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:34 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:34.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-06T13:07:34.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi186:9095"}]: dispatch 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: Upgrade: Setting container_image for all mgr 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: Reconfiguring iscsi.foo.smithi016.oxwhiv (dependencies changed)... 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: Reconfiguring daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:07:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:34 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:35.708 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:35 smithi186 ceph-mon[23420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:35.812 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:35 smithi016 ceph-mon[22420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:35.812 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:35 smithi016 ceph-mon[27395]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:38.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:37 smithi186 ceph-mon[23420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:38.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:37 smithi016 ceph-mon[22420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:38.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:37 smithi016 ceph-mon[27395]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:38.868 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:07:39.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:07:39.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.108 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.109 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.110 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/340970933' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.114 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/340970933' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:38 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:39.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/340970933' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:39.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:39.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:39.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:39.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:38 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:39.575 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 36s ago 11m - - 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 1s ago 11m - - 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (83s) 36s ago 6m 17.0M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (61s) 1s ago 5m 43.6M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 starting - - - - 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (28s) 1s ago 10m 494M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:07:39.576 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (56s) 36s ago 12m 491M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2910acc50571 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (12m) 36s ago 12m 56.5M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (10m) 1s ago 10m 56.2M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (11m) 36s ago 11m 50.2M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (89s) 36s ago 6m 8090k - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (65s) 1s ago 6m 17.4M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (10m) 36s ago 10m 51.7M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (9m) 36s ago 9m 54.2M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (9m) 36s ago 9m 48.7M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (9m) 36s ago 9m 50.3M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (8m) 1s ago 8m 53.5M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (8m) 1s ago 8m 52.5M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (8m) 1s ago 8m 49.1M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (7m) 1s ago 7m 52.1M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (33s) 1s ago 6m 50.6M - 2.33.4 514e6a882f6e 8210bbef0157 2024-05-06T13:07:39.577 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (5m) 36s ago 5m 73.3M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:07:39.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (5m) 1s ago 5m 72.2M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:07:39.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (5m) 36s ago 5m 73.4M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:07:39.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (4m) 1s ago 4m 72.0M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:07:40.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:07:40.022 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:40.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3873189042' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.024 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Cluster is now healthy 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3873189042' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]: dispatch 2024-05-06T13:07:40.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.033 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.033 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.033 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.033 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:40.033 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.033 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.034 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.035 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:39 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3873189042' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:40.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:40.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:40.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:40.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:39 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-05-06T13:07:40.402 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-05-06T13:07:40.403 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:07:40.403 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:07:40.840 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:07:41.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]': finished 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: osdmap e108: 8 total, 8 up, 8 in 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 387 B/s rd, 0 op/s 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3099778046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]': finished 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: osdmap e108: 8 total, 8 up, 8 in 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 387 B/s rd, 0 op/s 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3099778046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2787750520' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/3204069857"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/1748969103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2787750520' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/3204069857"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:40 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/1748969103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='client.? ' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/1305008881"}]': finished 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: osdmap e108: 8 total, 8 up, 8 in 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 387 B/s rd, 0 op/s 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3099778046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2787750520' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/3204069857"}]: dispatch 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:40 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1748969103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:07:42.228 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='client.35273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.229 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.230 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.231 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='client.35273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.232 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.233 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2787750520' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/3204069857"}]': finished 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: osdmap e109: 8 total, 8 up, 8 in 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.234 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3470201421' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2055860633"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.235 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.236 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2787750520' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/3204069857"}]': finished 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: osdmap e109: 8 total, 8 up, 8 in 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.237 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3470201421' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2055860633"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.238 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:41 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='client.35273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2787750520' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6800/3204069857"}]': finished 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: osdmap e109: 8 total, 8 up, 8 in 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3470201421' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2055860633"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:42.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:41 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 490 B/s rd, 0 op/s 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3470201421' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2055860633"}]': finished 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: osdmap e110: 8 total, 8 up, 8 in 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:42 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3956965261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/3204069857"}]: dispatch 2024-05-06T13:07:43.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 490 B/s rd, 0 op/s 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 490 B/s rd, 0 op/s 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3470201421' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2055860633"}]': finished 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: osdmap e110: 8 total, 8 up, 8 in 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3956965261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/3204069857"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3470201421' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/2055860633"}]': finished 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: osdmap e110: 8 total, 8 up, 8 in 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:42 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3956965261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/3204069857"}]: dispatch 2024-05-06T13:07:43.956 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.956 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.956 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.956 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.958 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.959 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.960 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3956965261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/3204069857"}]': finished 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: osdmap e111: 8 total, 8 up, 8 in 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.963 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.964 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3956965261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/3204069857"}]': finished 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: osdmap e111: 8 total, 8 up, 8 in 2024-05-06T13:07:43.965 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:43 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:44.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3956965261' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:6801/3204069857"}]': finished 2024-05-06T13:07:44.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: osdmap e111: 8 total, 8 up, 8 in 2024-05-06T13:07:44.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:43 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:44.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:07:44] "GET /metrics HTTP/1.1" 200 38241 "" "Prometheus/2.33.4" 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.073 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2805716433' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3844457359"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.074 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.075 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2805716433' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3844457359"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.076 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.077 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.078 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:44 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2805716433' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3844457359"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:45.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:44 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.046 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2805716433' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3844457359"}]': finished 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: osdmap e112: 8 total, 8 up, 8 in 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.047 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2805716433' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3844457359"}]': finished 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: osdmap e112: 8 total, 8 up, 8 in 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/771700613' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/161935968"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/771700613' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/161935968"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:45 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2805716433' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/3844457359"}]': finished 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: osdmap e112: 8 total, 8 up, 8 in 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/771700613' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/161935968"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:45 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/771700613' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/161935968"}]': finished 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: osdmap e113: 8 total, 8 up, 8 in 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:46 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/771700613' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/161935968"}]': finished 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: osdmap e113: 8 total, 8 up, 8 in 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/771700613' entity='client.iscsi.foo.smithi016.oxwhiv' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.16:0/161935968"}]': finished 2024-05-06T13:07:47.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: osdmap e113: 8 total, 8 up, 8 in 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:47.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:46 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:48 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.202 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.203 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.204 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.205 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.206 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.207 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.208 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.209 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.210 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:48.210 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:48.210 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:48.210 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:48.210 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:48 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:48.963 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:48.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:49 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:49.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:49 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:50.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:51 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:51.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:51 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:52 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:52.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:52.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:52.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:52 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:53 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:53.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:53.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:53.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:53.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:53.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:53 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.119 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.120 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.121 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.122 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.122 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:54.122 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:54.122 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:54.122 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:54.122 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:54.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:07:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:07:54] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.154 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 574 B/s rd, 0 op/s 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.155 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.156 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.157 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.158 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.158 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.158 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.158 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:55 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 574 B/s rd, 0 op/s 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 574 B/s rd, 0 op/s 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:55 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.285 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.286 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:56 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:56.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:56 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.135 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:57 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:57 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:58 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:58.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:58 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:07:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:07:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:59.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:07:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-05-06T13:07:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:07:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:07:59.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:07:59.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:07:59.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:07:59.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:07:59.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:07:59.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:07:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:00.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.267 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.269 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.270 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:01 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:01.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:01.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:01.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:01.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:01.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:01 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:02 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:02.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:02.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:02 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:03.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.326 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.326 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.326 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.326 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:04.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:08:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:08:04] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.33.4" 2024-05-06T13:08:05.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:05.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.398 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:05 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:05.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:05 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:06 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:06.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:06 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:07 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.296 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.297 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:07.298 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:07.299 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:07.299 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:07 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.344 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.345 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.346 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:08 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:08.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:08.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:08 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:08:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:08:08.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:08:09.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.288 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:09 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:09.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:09 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:10.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.237 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:08:11.327 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.327 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:11.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:11.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.338 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.338 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.338 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.338 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.339 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.340 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.341 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.343 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:11 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:11.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:11 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.038 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:08:12.038 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 68s ago 12m - - 2024-05-06T13:08:12.038 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 2s ago 11m - - 2024-05-06T13:08:12.038 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (116s) 68s ago 6m 17.0M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (94s) 2s ago 6m 43.0M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 starting - - - - 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (61s) 2s ago 11m 505M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (88s) 68s ago 12m 491M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2910acc50571 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (12m) 68s ago 13m 56.5M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (11m) 2s ago 11m 48.6M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (11m) 68s ago 11m 50.2M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (2m) 68s ago 7m 8090k - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (98s) 2s ago 7m 17.2M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (10m) 68s ago 10m 51.7M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (10m) 68s ago 10m 54.2M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:08:12.039 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (10m) 68s ago 10m 48.7M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (9m) 68s ago 9m 50.3M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (9m) 2s ago 9m 53.1M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (8m) 2s ago 8m 52.8M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (8m) 2s ago 8m 49.7M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (8m) 2s ago 8m 52.7M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (39s) 2s ago 7m 57.1M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (5m) 68s ago 5m 73.3M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (5m) 2s ago 5m 72.4M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (5m) 68s ago 5m 73.4M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:08:12.040 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (5m) 2s ago 5m 72.1M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:08:12.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.282 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:12 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.495 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:08:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:08:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:08:12.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:08:12.496 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:08:12.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:12.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:12.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:12.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:12.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:12.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:12.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:12 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:12.849 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:08:12.850 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.181 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.182 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2467527045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:13 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.286 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='client.15546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2467527045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.320 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/2467527045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:13.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:13 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/496968555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/496968555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:14 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/496968555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:14.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:14 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:14.823 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:08:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:08:14] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.33.4" 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:15 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.278 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.281 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.283 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:15.284 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:15.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:15.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:15.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:15.285 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:15 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:16 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:16.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:16.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:16.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:16.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:16.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:16 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.346 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.346 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.346 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.346 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.347 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.348 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.353 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:17 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:17.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:17 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.330 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:18 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:18.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:18 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:08:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:08:18.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:08:19.057 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:19.060 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.061 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:19.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.246 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.247 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:19 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:19.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:19.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:19.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:19.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:19.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:19 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.367 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.370 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:20 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:20.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:20 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:21.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:21 smithi016 ceph-mon[27395]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:21.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:21 smithi016 ceph-mon[22420]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:21.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:21 smithi186 ceph-mon[23420]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:23.313 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:23 smithi016 ceph-mon[22420]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:23.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:23 smithi016 ceph-mon[27395]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:23 smithi186 ceph-mon[23420]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:24.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:08:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:08:24] "GET /metrics HTTP/1.1" 200 38235 "" "Prometheus/2.33.4" 2024-05-06T13:08:25.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:25 smithi016 ceph-mon[22420]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:25.350 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:25 smithi016 ceph-mon[27395]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:25.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:25 smithi186 ceph-mon[23420]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:27.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:27 smithi016 ceph-mon[22420]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:27.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:27 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:27.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:27 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:27.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:27 smithi016 ceph-mon[27395]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:27.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:27 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:27.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:27 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:27.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:27 smithi186 ceph-mon[23420]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:27.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:27 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:27.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:27 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:28.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:28.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:28.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[22420]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:28.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:28.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:28.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:28.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[27395]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:28.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:28 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:28 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:28 smithi186 ceph-mon[23420]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:28 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:29.016 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:08:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:08:28.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:08:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:31.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:31.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:31 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:31 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:32.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:32 smithi016 ceph-mon[22420]: Detected new or changed devices on smithi016 2024-05-06T13:08:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:32 smithi016 ceph-mon[22420]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:32 smithi016 ceph-mon[22420]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-05-06T13:08:32.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:32 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi016 2024-05-06T13:08:32.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:32 smithi016 ceph-mon[27395]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:32.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:32 smithi016 ceph-mon[27395]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-05-06T13:08:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:32 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi016 2024-05-06T13:08:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:32 smithi186 ceph-mon[23420]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:32 smithi186 ceph-mon[23420]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-05-06T13:08:33.384 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:33.384 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:33 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:33.384 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:08:33.384 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:33 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:08:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:33.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:33.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:33.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:08:33.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:33 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:34.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[22420]: Upgrade: Updating mgr.y 2024-05-06T13:08:34.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[22420]: Deploying daemon mgr.y on smithi016 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[22420]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[27395]: Upgrade: Updating mgr.y 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[27395]: Deploying daemon mgr.y on smithi016 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[27395]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:34.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:34 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:34.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:34 smithi186 ceph-mon[23420]: Upgrade: Updating mgr.y 2024-05-06T13:08:34.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:34 smithi186 ceph-mon[23420]: Deploying daemon mgr.y on smithi016 2024-05-06T13:08:34.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:34 smithi186 ceph-mon[23420]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:34.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:34 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:34.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:34 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:34.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:08:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:08:34] "GET /metrics HTTP/1.1" 200 38307 "" "Prometheus/2.33.4" 2024-05-06T13:08:34.876 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:34 smithi016 systemd[1]: Stopping Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:08:35.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:34 smithi016 podman[88733]: 2024-05-06 13:08:34.87623323 +0000 UTC m=+0.128236621 container died 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T13:08:35.452 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 podman[88733]: 2024-05-06 13:08:35.177649159 +0000 UTC m=+0.429652555 container cleanup 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:08:35.453 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 bash[88733]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y 2024-05-06T13:08:35.453 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 podman[88747]: 2024-05-06 13:08:35.303936174 +0000 UTC m=+0.425123365 container remove 2910acc50571f0758495f28db7d3d5bf547566240b54533d35cabbb729e6c1ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-06T13:08:35.453 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:08:35.507 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:35 smithi186 ceph-mon[23420]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:08:35.753 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:35 smithi016 ceph-mon[22420]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:08:35.754 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:35 smithi016 ceph-mon[27395]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:08:35.754 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-05-06T13:08:35.754 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 systemd[1]: Stopped Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:08:35.754 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Consumed 26.247s CPU time. 2024-05-06T13:08:36.040 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 systemd[1]: Starting Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:08:36.083 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 podman[88879]: 2024-05-06 13:08:35.963207443 +0000 UTC m=+0.107613363 container create 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, distribution-scope=public, ceph=True, io.openshift.tags=base centos centos-stream, vcs-type=git, version=8, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_CLEAN=True, vendor=Red Hat, Inc., name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, maintainer=Guillaume Abrioux , release=754, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-05-06T13:08:36.083 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:35 smithi016 podman[88879]: 2024-05-06 13:08:35.874584102 +0000 UTC m=+0.018989987 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-06T13:08:36.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 podman[88879]: 2024-05-06 13:08:36.13218559 +0000 UTC m=+0.276591465 container init 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, ceph=True, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, architecture=x86_64, io.openshift.expose-services=, vcs-type=git, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, version=8, maintainer=Guillaume Abrioux , release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, name=centos-stream) 2024-05-06T13:08:36.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 podman[88879]: 2024-05-06 13:08:36.134999816 +0000 UTC m=+0.279405694 container start 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, distribution-scope=public, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , RELEASE=HEAD, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, name=centos-stream, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-06T13:08:36.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 ceph-mgr[88897]: -- 172.21.15.16:0/1202401583 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562db5d24340 con 0x562db5cfc800 2024-05-06T13:08:36.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 bash[88879]: 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c 2024-05-06T13:08:36.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 systemd[1]: Started Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:08:36.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:36.286+0000 7fb4bcee2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:08:36.871 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:36.426+0000 7fb4bcee2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:08:36.872 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:36.532+0000 7fb4bcee2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:08:36.872 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:36.870+0000 7fb4bcee2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:08:37.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:36 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:36.960+0000 7fb4bcee2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:08:37.534 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:37 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:37.534 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:37 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:37.535 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:37 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:37.535 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:37 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:37.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:37 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:37 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:38.479 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:38 smithi016 ceph-mon[22420]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:38.479 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:38 smithi016 ceph-mon[27395]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:38.480 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:38.213+0000 7fb4bcee2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:08:38.480 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:38.392+0000 7fb4bcee2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:08:38.480 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:38.479+0000 7fb4bcee2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:08:38.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:38 smithi186 ceph-mon[23420]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:39.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:08:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:08:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:08:39.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:38.821+0000 7fb4bcee2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:08:39.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:38.929+0000 7fb4bcee2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:08:39.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:39.026+0000 7fb4bcee2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:08:39.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:39 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:39.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:39.288+0000 7fb4bcee2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:08:39.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:39 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:39.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:39 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:40.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:39 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:39.777+0000 7fb4bcee2000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:08:40.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:40 smithi016 ceph-mon[22420]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:40.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:40.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:40 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:40.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:40 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:40.304+0000 7fb4bcee2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:08:40.674 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:40 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:40.407+0000 7fb4bcee2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:08:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:40 smithi016 ceph-mon[27395]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:40.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:40 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:40.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:40 smithi186 ceph-mon[23420]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:40.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:40.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:40 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:41.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:40 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:40.727+0000 7fb4bcee2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:08:41.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:40 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:40.824+0000 7fb4bcee2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:08:41.547 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:41.257+0000 7fb4bcee2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:08:41.547 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:41.425+0000 7fb4bcee2000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:08:41.547 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:41.546+0000 7fb4bcee2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:08:41.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:41.679+0000 7fb4bcee2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:08:41.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:41 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:41.795+0000 7fb4bcee2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:08:42.550 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:42.416+0000 7fb4bcee2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:08:42.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:42 smithi016 ceph-mon[22420]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:42.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:42.551 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:42 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:42.551 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:42 smithi016 ceph-mon[27395]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:42.551 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:42.551 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:42 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:42 smithi186 ceph-mon[23420]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s 2024-05-06T13:08:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:42 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:43.148 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:42.816+0000 7fb4bcee2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:08:43.148 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: [06/May/2024:13:08:42] ENGINE Bus STARTING 2024-05-06T13:08:43.148 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: CherryPy Checker: 2024-05-06T13:08:43.148 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: The Application mounted at '' has an empty config. 2024-05-06T13:08:43.149 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: 2024-05-06T13:08:43.149 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: [06/May/2024:13:08:42] ENGINE Serving on http://:::9283 2024-05-06T13:08:43.149 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[88893]: [06/May/2024:13:08:42] ENGINE Bus STARTED 2024-05-06T13:08:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[22420]: Standby manager daemon y restarted 2024-05-06T13:08:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[22420]: Standby manager daemon y started 2024-05-06T13:08:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:08:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:08:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:08:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:08:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[27395]: Standby manager daemon y restarted 2024-05-06T13:08:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:08:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:08:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:08:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:08:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:43 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:08:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:43 smithi186 ceph-mon[23420]: Standby manager daemon y restarted 2024-05-06T13:08:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:43 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:08:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:43 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:08:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:43 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:08:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:43 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:08:43.667 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:43 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:08:43.684 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:08:44.376 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:08:44.376 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 4s ago 12m - - 2024-05-06T13:08:44.376 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 14s ago 12m - - 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (2m) 4s ago 7m 17.8M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (2m) 14s ago 6m 43.3M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (66s) 4s ago 5m 46.5M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (93s) 14s ago 11m 507M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (8s) 4s ago 13m 63.1M - 17.2.0 e1d6a67b021e 325dcd07ed12 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (13m) 4s ago 13m 63.5M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (11m) 14s ago 11m 53.0M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (12m) 4s ago 12m 49.6M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (2m) 4s ago 7m 18.5M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (2m) 14s ago 7m 17.1M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (11m) 4s ago 11m 52.7M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (11m) 4s ago 10m 54.4M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (10m) 4s ago 10m 49.9M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (10m) 4s ago 10m 51.6M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:08:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (9m) 14s ago 9m 53.3M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (9m) 14s ago 9m 52.9M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (9m) 14s ago 9m 49.9M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (8m) 14s ago 8m 52.8M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (72s) 14s ago 8m 57.2M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (6m) 4s ago 6m 73.9M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (6m) 14s ago 6m 72.4M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (6m) 4s ago 6m 74.0M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:08:44.378 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (6m) 14s ago 6m 72.2M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:08:44.513 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:44 smithi016 ceph-mon[22420]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:44.514 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:44 smithi016 ceph-mon[22420]: mgrmap e38: x(active, since 84s), standbys: y 2024-05-06T13:08:44.514 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:44 smithi016 ceph-mon[27395]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:44.514 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:44 smithi016 ceph-mon[27395]: mgrmap e38: x(active, since 84s), standbys: y 2024-05-06T13:08:44.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:44 smithi186 ceph-mon[23420]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:08:44.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:44 smithi186 ceph-mon[23420]: mgrmap e38: x(active, since 84s), standbys: y 2024-05-06T13:08:44.792 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:08:44.793 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:08:44.794 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:08:45.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:08:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:08:44] "GET /metrics HTTP/1.1" 200 38307 "" "Prometheus/2.33.4" 2024-05-06T13:08:45.165 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:08:45.165 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:08:45.165 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:08:45.165 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:08:45.165 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-05-06T13:08:45.165 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "1/23 daemons upgraded", 2024-05-06T13:08:45.166 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mgr daemons", 2024-05-06T13:08:45.166 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:08:45.166 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:08:45.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:45 smithi016 ceph-mon[22420]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:45.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:45 smithi016 ceph-mon[22420]: from='client.25483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:45.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:45 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3819593956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:45.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:45 smithi016 ceph-mon[27395]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:45.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:45 smithi016 ceph-mon[27395]: from='client.25483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:45.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:45 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3819593956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:45.592 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:08:45.592 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:08:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:08:45.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:45 smithi186 ceph-mon[23420]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:45.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:45 smithi186 ceph-mon[23420]: from='client.25483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:45.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:45 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3819593956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:08:46.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[22420]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:46.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[22420]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:46.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[22420]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:46.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[22420]: from='client.? 172.21.15.16:0/3509379692' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:08:46.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[27395]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:46.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[27395]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:46.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[27395]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:46.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:46 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/3509379692' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:08:46.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:46 smithi186 ceph-mon[23420]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:46.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:46 smithi186 ceph-mon[23420]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:08:46.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:46 smithi186 ceph-mon[23420]: from='client.15600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:08:46.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:46 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/3509379692' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:08:47.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-05-06T13:08:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:47 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:47.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:47 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:08:48.751 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:48 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:48.751 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:48 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:48.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:48 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:48.765 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:08:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:08:48.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:08:49.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:49 smithi016 ceph-mon[22420]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:49.905 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:49 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:49 smithi016 ceph-mon[27395]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:49 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:50.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:49 smithi186 ceph-mon[23420]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:50.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:49 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:08:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: Upgrade: Updating mgr.y 2024-05-06T13:08:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: Deploying daemon mgr.y on smithi016 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: Upgrade: Updating mgr.y 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:08:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:51.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: Deploying daemon mgr.y on smithi016 2024-05-06T13:08:51.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:50 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: Upgrade: Updating mgr.y 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: Deploying daemon mgr.y on smithi016 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:50 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:52.005 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:51 smithi016 systemd[1]: Stopping Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:08:52.259 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 podman[91134]: 2024-05-06 13:08:52.005630041 +0000 UTC m=+0.137041062 container died 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, io.openshift.expose-services=, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, RELEASE=HEAD, ceph=True, vcs-type=git, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, version=8, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870) 2024-05-06T13:08:52.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:52 smithi016 ceph-mon[22420]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:52.576 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 podman[91134]: 2024-05-06 13:08:52.324568266 +0000 UTC m=+0.455979285 container cleanup 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, ceph=True, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, release=754, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, io.openshift.expose-services=, io.buildah.version=1.19.8) 2024-05-06T13:08:52.576 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 bash[91134]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y 2024-05-06T13:08:52.576 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:52 smithi016 ceph-mon[27395]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:52.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:52 smithi186 ceph-mon[23420]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:52.916 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 podman[91148]: 2024-05-06 13:08:52.576325673 +0000 UTC m=+0.573020153 container remove 325dcd07ed12cd47bb0efc703ae8ef9203227b5a45afc89f56b2f286fcf2b29c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, vendor=Red Hat, Inc., release=754, GIT_BRANCH=HEAD, distribution-scope=public, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, ceph=True, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux ) 2024-05-06T13:08:52.916 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:08:52.916 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-05-06T13:08:52.916 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 systemd[1]: Stopped Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:08:52.916 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:52 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Consumed 8.097s CPU time. 2024-05-06T13:08:53.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 systemd[1]: Starting Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:08:53.497 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 podman[91277]: 2024-05-06 13:08:53.218931082 +0000 UTC m=+0.093857958 container create 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-06T13:08:53.498 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 podman[91277]: 2024-05-06 13:08:53.144099936 +0000 UTC m=+0.019026833 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:08:53.498 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 podman[91277]: 2024-05-06 13:08:53.438114494 +0000 UTC m=+0.313041374 container init 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-70ce953) 2024-05-06T13:08:53.498 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 podman[91277]: 2024-05-06 13:08:53.440690826 +0000 UTC m=+0.315617708 container start 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-06T13:08:53.498 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 ceph-mgr[91296]: -- 172.21.15.16:0/4108981378 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649d4e6e5a0 con 0x5649d4e42c00 2024-05-06T13:08:53.806 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 bash[91277]: 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 2024-05-06T13:08:53.807 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 systemd[1]: Started Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:08:53.807 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:53.608+0000 7fed33517200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:08:54.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:53.806+0000 7fed33517200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:08:54.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:53 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:53.916+0000 7fed33517200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:08:54.364 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:54 smithi186 ceph-mon[23420]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:54.364 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:54.364 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:54 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:54.621 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:54.284+0000 7fed33517200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:08:54.622 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:54.377+0000 7fed33517200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:08:54.622 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:54 smithi016 ceph-mon[27395]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:54.622 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:54.622 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:54 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:54.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:54 smithi016 ceph-mon[22420]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:54.622 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:54.623 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:54 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:54.658 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:08:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:08:54] "GET /metrics HTTP/1.1" 200 38302 "" "Prometheus/2.33.4" 2024-05-06T13:08:55.687 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:55 smithi186 ceph-mon[23420]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:55.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:55 smithi016 ceph-mon[22420]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:55.734 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:55 smithi016 ceph-mon[27395]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:08:56.150 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:55.733+0000 7fed33517200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:08:56.150 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:55.954+0000 7fed33517200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:08:56.150 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:56.149+0000 7fed33517200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:08:56.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:56.461+0000 7fed33517200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:08:56.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:56.559+0000 7fed33517200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:08:57.167 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:56.779+0000 7fed33517200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:08:57.167 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:56 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:56.993+0000 7fed33517200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:08:57.897 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:57 smithi016 ceph-mon[22420]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:08:57.897 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:57.661+0000 7fed33517200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:08:57.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:57 smithi016 ceph-mon[27395]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:08:58.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:57 smithi186 ceph-mon[23420]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:08:58.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:58.121+0000 7fed33517200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:08:58.469 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:58.243+0000 7fed33517200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:08:58.923 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:58.469+0000 7fed33517200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:08:59.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:08:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:08:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:08:59.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:59.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:59 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:59.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:08:59 smithi016 ceph-mon[22420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:59.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.045+0000 7fed33517200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:08:59.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.148+0000 7fed33517200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:08:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:59 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:59.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:08:59 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:59 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:08:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:08:59 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:08:59.684 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.428+0000 7fed33517200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:08:59.684 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.578+0000 7fed33517200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:08:59.941 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.684+0000 7fed33517200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:08:59.941 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.819+0000 7fed33517200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:08:59.941 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:08:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:08:59.941+0000 7fed33517200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:09:00.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:00 smithi016 ceph-mon[27395]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:00.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:00.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:00 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:00.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:00 smithi016 ceph-mon[22420]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:00.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:00.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:00 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:00.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:00 smithi186 ceph-mon[23420]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:00.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:00.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:00 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:01.111 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:00.828+0000 7fed33517200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:09:01.112 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:01.068+0000 7fed33517200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:09:01.112 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: [06/May/2024:13:09:01] ENGINE Bus STARTING 2024-05-06T13:09:01.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[22420]: Standby manager daemon y restarted 2024-05-06T13:09:01.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[22420]: Standby manager daemon y started 2024-05-06T13:09:01.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:09:01.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:09:01.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[22420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[27395]: Standby manager daemon y restarted 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:01 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:09:01.424 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: CherryPy Checker: 2024-05-06T13:09:01.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: The Application mounted at '' has an empty config. 2024-05-06T13:09:01.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:01.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: [06/May/2024:13:09:01] ENGINE Serving on http://:::9283 2024-05-06T13:09:01.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:01 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: [06/May/2024:13:09:01] ENGINE Bus STARTED 2024-05-06T13:09:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:01 smithi186 ceph-mon[23420]: Standby manager daemon y restarted 2024-05-06T13:09:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:01 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:09:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:09:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:09:01.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:09:01.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:01 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/1582279971' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:09:02.496 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:02 smithi016 ceph-mon[22420]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:02.496 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:02 smithi016 ceph-mon[22420]: mgrmap e39: x(active, since 103s), standbys: y 2024-05-06T13:09:02.496 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:02 smithi016 ceph-mon[27395]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:02.496 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:02 smithi016 ceph-mon[27395]: mgrmap e39: x(active, since 103s), standbys: y 2024-05-06T13:09:02.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:02 smithi186 ceph-mon[23420]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:02.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:02 smithi186 ceph-mon[23420]: mgrmap e39: x(active, since 103s), standbys: y 2024-05-06T13:09:03.608 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:03.608 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:03.608 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 0 op/s 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-06T13:09:03.609 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[22420]: Upgrade: It appears safe to stop mon.a 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 0 op/s 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:03.610 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:03.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:09:03.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:09:03.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-06T13:09:03.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:03.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-06T13:09:03.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:03 smithi016 ceph-mon[27395]: Upgrade: It appears safe to stop mon.a 2024-05-06T13:09:04.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:04.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:04.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1020 B/s rd, 0 op/s 2024-05-06T13:09:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-05-06T13:09:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-06T13:09:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:03 smithi186 ceph-mon[23420]: Upgrade: It appears safe to stop mon.a 2024-05-06T13:09:04.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: Upgrade: Updating mon.a 2024-05-06T13:09:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:04.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:04.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[22420]: Deploying daemon mon.a on smithi016 2024-05-06T13:09:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: Upgrade: Updating mon.a 2024-05-06T13:09:04.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:04.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:04.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:04.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:04.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:04 smithi016 ceph-mon[27395]: Deploying daemon mon.a on smithi016 2024-05-06T13:09:05.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:09:04] "GET /metrics HTTP/1.1" 200 38306 "" "Prometheus/2.33.4" 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: Upgrade: Updating mon.a 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='mgr.x' 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: from='mgr.35180 172.21.15.186:0/1058215796' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:04 smithi186 ceph-mon[23420]: Deploying daemon mon.a on smithi016 2024-05-06T13:09:05.843 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:05 smithi016 ceph-mon[22420]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:05.843 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:05 smithi016 ceph-mon[27395]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:06.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:05 smithi186 ceph-mon[23420]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:06.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:06 smithi016 systemd[1]: Stopping Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:09:07.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a[22415]: 2024-05-06T13:09:07.103+0000 7ff37fa4a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:09:07.195 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a[22415]: 2024-05-06T13:09:07.103+0000 7ff37fa4a700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-06T13:09:07.546 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:07 smithi016 podman[92819]: 2024-05-06 13:09:07.246155273 +0000 UTC m=+0.248389784 container died a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, ceph=True, RELEASE=HEAD, name=centos-stream, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , distribution-scope=public, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., release=754, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-06T13:09:07.862 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:07 smithi016 podman[92819]: 2024-05-06 13:09:07.637159291 +0000 UTC m=+0.639393802 container cleanup a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, release=754, ceph=True, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, RELEASE=HEAD, com.redhat.component=centos-stream-container) 2024-05-06T13:09:07.863 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:07 smithi016 bash[92819]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a 2024-05-06T13:09:08.141 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:07 smithi016 podman[92908]: 2024-05-06 13:09:07.863301634 +0000 UTC m=+0.615845279 container remove a4db6a346120bbc242afd83f396f03dcd94ed39d3699baadc5d69182a341a5d7 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, name=centos-stream, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, distribution-scope=public, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD, architecture=x86_64, release=754, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True) 2024-05-06T13:09:08.141 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:08 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-06T13:09:08.141 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:08 smithi016 systemd[1]: Stopped Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:09:08.141 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:08 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service: Consumed 21.000s CPU time. 2024-05-06T13:09:08.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:08 smithi016 systemd[1]: Starting Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:09:09.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:09:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:09:08.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:09:09.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 podman[93142]: 2024-05-06 13:09:09.02649771 +0000 UTC m=+0.340504541 container create 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-06T13:09:09.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 podman[93142]: 2024-05-06 13:09:08.934338733 +0000 UTC m=+0.248345583 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 podman[93142]: 2024-05-06 13:09:09.23798572 +0000 UTC m=+0.551992560 container init 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_CLEAN=True) 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 podman[93142]: 2024-05-06 13:09:09.241494501 +0000 UTC m=+0.555501333 container start 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev), process ceph-mon, pid 2 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: pidfile_write: ignore empty --pid-file 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: load: jerasure load: lrc 2024-05-06T13:09:09.555 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: RocksDB version: 7.9.2 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Git sha 0 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Compile date 2024-05-03 15:08:47 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: DB SUMMARY 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: DB Session ID: 8DNXDJNQKNYFA2I1QH81 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: CURRENT file: CURRENT 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1932 Bytes 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000045.sst 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000043.log size: 2306890 ; 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.error_if_exists: 0 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.create_if_missing: 0 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.paranoid_checks: 1 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T13:09:09.556 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.env: 0x558298c1ac60 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.info_log: 0x55829ad7bac0 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.statistics: (nil) 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.use_fsync: 0 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_log_file_size: 0 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.allow_fallocate: 1 2024-05-06T13:09:09.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.use_direct_reads: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.db_log_dir: 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.wal_dir: 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T13:09:09.558 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.write_buffer_manager: 0x55829ad4e820 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.unordered_write: 0 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.row_cache: None 2024-05-06T13:09:09.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.wal_filter: None 2024-05-06T13:09:09.560 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.two_write_queues: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.wal_compression: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.atomic_flush: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.log_readahead_size: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T13:09:09.561 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_background_jobs: 2 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_background_compactions: -1 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_subcompactions: 1 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T13:09:09.562 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_open_files: -1 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_background_flushes: -1 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Compression algorithms supported: 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T13:09:09.563 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kZSTD supported: 0 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kXpressCompression supported: 0 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kZlibCompression supported: 1 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kSnappyCompression supported: 1 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kLZ4Compression supported: 1 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: kBZip2Compression supported: 0 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T13:09:09.564 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.merge_operator: 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_filter: None 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55829ad7bbc0) 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_type: 0 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_index_type: 0 2024-05-06T13:09:09.565 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_shortening: 1 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: checksum: 4 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: no_block_cache: 0 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache: 0x55829ad7f090 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_options: 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: capacity : 536870912 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_shard_bits : 4 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: strict_capacity_limit : 0 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_cache_compressed: (nil) 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: persistent_cache: (nil) 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size: 4096 2024-05-06T13:09:09.566 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_size_deviation: 10 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_restart_interval: 16 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: index_block_restart_interval: 1 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: metadata_block_size: 4096 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: partition_filters: 0 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: use_delta_encoding: 1 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: filter_policy: bloomfilter 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: whole_key_filtering: 1 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: verify_compression: 0 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: format_version: 5 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_index_compression: 1 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: block_align: 0 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: max_auto_readahead_size: 262144 2024-05-06T13:09:09.567 INFO:journalctl@ceph.mon.a.smithi016.stdout: prepopulate_block_cache: 0 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout: initial_auto_readahead_size: 8192 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression: NoCompression 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.num_levels: 7 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T13:09:09.568 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T13:09:09.569 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T13:09:09.570 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T13:09:09.571 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.table_properties_collectors: 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.inplace_update_support: 0 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.bloom_locality: 0 2024-05-06T13:09:09.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.max_successive_merges: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.ttl: 2592000 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.enable_blob_files: false 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.min_blob_size: 0 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T13:09:09.573 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 45.sst 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 47, last_sequence is 21851, log_number is 43,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 43 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 91dcdf0e-aa05-4153-8aee-3ede9bea5d75 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000949270648, "job": 1, "event": "recovery_started", "wal_files": [43]} 2024-05-06T13:09:09.574 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #43 mode 2 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000949278360, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 48, "file_size": 2110914, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 21852, "largest_seqno": 23424, "table_properties": {"data_size": 2104338, "index_size": 3573, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 18646, "raw_average_key_size": 23, "raw_value_size": 2089643, "raw_average_value_size": 2648, "num_data_blocks": 158, "num_entries": 789, "num_filter_entries": 789, "num_deletions": 1, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715000949, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "91dcdf0e-aa05-4153-8aee-3ede9bea5d75", "db_session_id": "8DNXDJNQKNYFA2I1QH81", "orig_file_number": 48, "seqno_to_time_mapping": "N/A"}} 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000949278460, "job": 1, "event": "recovery_finished"} 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/version_set.cc:5047] Creating manifest 50 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000043.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55829ae70000 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: DB pointer 0x55829ae5a000 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** DB Stats ** 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:09:09.575 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: L0 1/0 2.01 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: L6 1/0 8.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: Sum 2/0 10.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T13:09:09.576 INFO:journalctl@ceph.mon.a.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 506.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: Cumulative compaction: 0.00 GB write, 197.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:09:09.577 INFO:journalctl@ceph.mon.a.smithi016.stdout: Interval compaction: 0.00 GB write, 197.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: Block cache BinnedLRUCache@0x55829ad7f090#2 capacity: 512.00 MB usage: 6.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: starting mon.a rank 0 at public addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] at bind addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???) e3 preinit fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).mds e1 new map 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).mds e1 print_map 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: e1 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T13:09:09.578 INFO:journalctl@ceph.mon.a.smithi016.stdout: legacy client fscid: -1 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout: 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout: No filesystems configured 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 ceph-mon[93192]: mon.a@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 bash[93142]: 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 2024-05-06T13:09:09.579 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:09 smithi016 systemd[1]: Started Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:09:10.849 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:10 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: ignoring --setuser ceph since I am not root 2024-05-06T13:09:10.849 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:10 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: ignoring --setgroup ceph since I am not root 2024-05-06T13:09:10.849 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mgr[91296]: -- 172.21.15.16:0/2397021210 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5559a36c05a0 con 0x5559a3694c00 2024-05-06T13:09:10.849 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: mon.a calling monitor election 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: monmap epoch 3 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: min_mon_release 17 (quincy) 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: election_strategy: 1 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:10.850 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: fsmap 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: osdmap e113: 8 total, 8 up, 8 in 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: mgrmap e39: x(active, since 112s), standbys: y 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: Health detail: HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: [WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: from='mgr.35180 ' entity='' 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: mgrmap e40: x(active, since 112s), standbys: y 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[93192]: from='mgr.35180 ' entity='' 2024-05-06T13:09:10.851 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: mon.a calling monitor election 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: monmap epoch 3 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: min_mon_release 17 (quincy) 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: election_strategy: 1 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:10.852 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: fsmap 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: osdmap e113: 8 total, 8 up, 8 in 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: mgrmap e39: x(active, since 112s), standbys: y 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: Health detail: HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: [WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='' 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: mgrmap e40: x(active, since 112s), standbys: y 2024-05-06T13:09:10.853 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:10 smithi016 ceph-mon[27395]: from='mgr.35180 ' entity='' 2024-05-06T13:09:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ignoring --setuser ceph since I am not root 2024-05-06T13:09:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ignoring --setgroup ceph since I am not root 2024-05-06T13:09:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mgr[56659]: -- 172.21.15.186:0/2948088214 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fda8bf25a0 con 0x55fda8bc6c00 2024-05-06T13:09:11.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:10.889+0000 7f9a789cc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 637 B/s rd, 0 op/s 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: mon.a calling monitor election 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: monmap epoch 3 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: min_mon_release 17 (quincy) 2024-05-06T13:09:11.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: election_strategy: 1 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: fsmap 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: osdmap e113: 8 total, 8 up, 8 in 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: mgrmap e39: x(active, since 112s), standbys: y 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: Health detail: HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: [WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='' 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: mgrmap e40: x(active, since 112s), standbys: y 2024-05-06T13:09:11.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:10 smithi186 ceph-mon[23420]: from='mgr.35180 ' entity='' 2024-05-06T13:09:11.123 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:10 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:10.893+0000 7fee7b3ad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T13:09:11.123 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:11 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:11.087+0000 7fee7b3ad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:09:11.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:11 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:11.200+0000 7fee7b3ad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:09:11.489 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:11.072+0000 7f9a789cc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:09:11.489 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:11.175+0000 7f9a789cc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T13:09:11.489 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:11.487+0000 7f9a789cc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:09:11.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:11.572+0000 7f9a789cc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:09:11.810 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:11 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:11.544+0000 7fee7b3ad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T13:09:11.810 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:11 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:11.636+0000 7fee7b3ad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T13:09:13.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:12.772+0000 7f9a789cc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:09:13.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:12.945+0000 7f9a789cc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:09:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:12 smithi186 ceph-mon[23420]: mgrmap e41: x(active, since 113s), standbys: y 2024-05-06T13:09:13.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:12 smithi016 ceph-mon[93192]: mgrmap e41: x(active, since 113s), standbys: y 2024-05-06T13:09:13.097 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:12.941+0000 7fee7b3ad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T13:09:13.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:12 smithi016 ceph-mon[27395]: mgrmap e41: x(active, since 113s), standbys: y 2024-05-06T13:09:13.275 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:13.129+0000 7f9a789cc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:09:13.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:13.129+0000 7fee7b3ad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T13:09:13.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:13.322+0000 7fee7b3ad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T13:09:13.556 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:13.455+0000 7f9a789cc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:09:13.732 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:13.633+0000 7fee7b3ad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T13:09:13.853 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:13.555+0000 7f9a789cc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:09:13.853 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:13.774+0000 7f9a789cc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:09:14.153 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:13.732+0000 7fee7b3ad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T13:09:14.153 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:13.949+0000 7fee7b3ad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T13:09:14.214 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:13.975+0000 7f9a789cc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:09:14.425 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:14.153+0000 7fee7b3ad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T13:09:15.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:14.607+0000 7f9a789cc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:09:15.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:14 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:14.795+0000 7fee7b3ad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-06T13:09:15.374 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:15.061+0000 7f9a789cc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:09:15.374 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:15.165+0000 7f9a789cc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:09:15.562 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:15.244+0000 7fee7b3ad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T13:09:15.562 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:15.346+0000 7fee7b3ad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T13:09:15.712 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:15.385+0000 7f9a789cc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:09:15.986 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:15.931+0000 7f9a789cc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:09:16.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:16.026+0000 7f9a789cc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:09:16.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:15.562+0000 7fee7b3ad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-06T13:09:16.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.121+0000 7fee7b3ad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T13:09:16.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.220+0000 7fee7b3ad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T13:09:16.629 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:16.275+0000 7f9a789cc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:09:16.629 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:16.411+0000 7f9a789cc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:09:16.629 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:16.510+0000 7f9a789cc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:09:16.629 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:16.628+0000 7f9a789cc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:09:16.851 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.481+0000 7fee7b3ad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T13:09:16.851 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.623+0000 7fee7b3ad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T13:09:16.851 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.726+0000 7fee7b3ad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T13:09:16.851 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.850+0000 7fee7b3ad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T13:09:17.018 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:16.725+0000 7f9a789cc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:09:17.173 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:16 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:16.950+0000 7fee7b3ad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T13:09:17.830 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:17.549+0000 7f9a789cc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:09:17.830 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:17.773+0000 7f9a789cc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:09:18.163 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:17.817+0000 7fee7b3ad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T13:09:18.163 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:18.055+0000 7fee7b3ad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T13:09:18.163 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: [06/May/2024:13:09:18] ENGINE Bus STARTING 2024-05-06T13:09:18.163 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: CherryPy Checker: 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: Active manager daemon x restarted 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: Activating manager daemon x 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: mgrmap e42: x(active, starting, since 0.00630378s), standbys: y 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:09:18.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[93192]: Manager daemon x is now available 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: Active manager daemon x restarted 2024-05-06T13:09:18.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: Activating manager daemon x 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: mgrmap e42: x(active, starting, since 0.00630378s), standbys: y 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:09:18.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:09:18.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:09:18.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:09:18.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:09:18.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:09:18.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:17 smithi016 ceph-mon[27395]: Manager daemon x is now available 2024-05-06T13:09:18.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:17 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:09:17] ENGINE Bus STARTING 2024-05-06T13:09:18.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: CherryPy Checker: 2024-05-06T13:09:18.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: The Application mounted at '' has an empty config. 2024-05-06T13:09:18.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:18.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:09:18] ENGINE Serving on http://:::9283 2024-05-06T13:09:18.265 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:09:18] ENGINE Bus STARTED 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: Active manager daemon x restarted 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: Activating manager daemon x 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: mgrmap e42: x(active, starting, since 0.00630378s), standbys: y 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-06T13:09:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-06T13:09:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:17 smithi186 ceph-mon[23420]: Manager daemon x is now available 2024-05-06T13:09:18.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: The Application mounted at '' has an empty config. 2024-05-06T13:09:18.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: 2024-05-06T13:09:18.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: [06/May/2024:13:09:18] ENGINE Serving on http://:::9283 2024-05-06T13:09:18.423 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:09:18 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y[91292]: [06/May/2024:13:09:18] ENGINE Bus STARTED 2024-05-06T13:09:18.811 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:09:19.135 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:18.784+0000 7f9a35e30700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-06T13:09:19.135 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:19.135 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:09:19.135 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:09:19.136 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:09:19.136 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:09:19.136 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:19.136 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:09:19.136 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:09:19.136 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: Standby manager daemon y restarted 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: Standby manager daemon y started 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:19.137 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:19.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: Reconfiguring daemon agent.smithi016 on smithi016 2024-05-06T13:09:19.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:18 smithi186 ceph-mon[23420]: mgrmap e43: x(active, since 1.00863s), standbys: y 2024-05-06T13:09:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:09:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:09:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:09:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:09:19.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:19.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:09:19.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:09:19.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:09:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:09:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: Standby manager daemon y restarted 2024-05-06T13:09:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: Standby manager daemon y started 2024-05-06T13:09:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:09:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:09:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:09:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:09:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: Reconfiguring daemon agent.smithi016 on smithi016 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[93192]: mgrmap e43: x(active, since 1.00863s), standbys: y 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi186", "caps": []}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi016", "caps": []}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-06T13:09:19.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: Standby manager daemon y restarted 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: Standby manager daemon y started 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.? 172.21.15.16:0/3581910628' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: Reconfiguring daemon agent.smithi016 on smithi016 2024-05-06T13:09:19.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:18 smithi016 ceph-mon[27395]: mgrmap e43: x(active, since 1.00863s), standbys: y 2024-05-06T13:09:19.606 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:09:19.606 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 starting - - - - 2024-05-06T13:09:19.606 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 29s ago 12m - - 2024-05-06T13:09:19.606 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (3m) 21s ago 7m 23.0M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:09:19.606 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (2m) 29s ago 7m 50.2M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (102s) 21s ago 6m 46.6M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (2m) 29s ago 12m 510M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (26s) 21s ago 14m 63.1M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (14m) 21s ago 14m 64.5M 2048M 17.2.0 e1d6a67b021e a4db6a346120 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (12m) 29s ago 12m 53.8M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (12m) 21s ago 12m 51.6M 2048M 17.2.0 e1d6a67b021e ccff3d350519 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (3m) 21s ago 8m 18.2M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (2m) 29s ago 8m 17.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (11m) 21s ago 11m 52.9M 4096M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (11m) 21s ago 11m 54.5M 4096M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (11m) 21s ago 11m 50.0M 4096M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:09:19.607 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (10m) 21s ago 10m 51.8M 4096M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (10m) 29s ago 10m 53.5M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (10m) 29s ago 10m 53.1M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (9m) 29s ago 9m 50.0M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (9m) 29s ago 9m 52.9M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (107s) 29s ago 8m 57.3M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (6m) 21s ago 6m 74.0M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (6m) 29s ago 6m 72.5M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (6m) 21s ago 6m 74.1M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:09:19.608 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (6m) 29s ago 6m 72.5M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:09:20.039 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:09:20.039 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:09:20.039 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": {}, 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:09:20.040 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-05-06T13:09:20.041 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:09:20.041 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:09:20.041 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:09:20.082 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: from='client.25531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.082 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:20.082 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:20.082 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:20.082 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: [06/May/2024:13:09:19] ENGINE Bus STARTING 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: [06/May/2024:13:09:19] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: [06/May/2024:13:09:19] ENGINE Serving on https://172.21.15.186:7150 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: [06/May/2024:13:09:19] ENGINE Bus STARTED 2024-05-06T13:09:20.083 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-05-06T13:09:20.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:19 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T13:09:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: from='client.25531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: [06/May/2024:13:09:19] ENGINE Bus STARTING 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: [06/May/2024:13:09:19] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: [06/May/2024:13:09:19] ENGINE Serving on https://172.21.15.186:7150 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: [06/May/2024:13:09:19] ENGINE Bus STARTED 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-05-06T13:09:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: from='client.25531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: [06/May/2024:13:09:19] ENGINE Bus STARTING 2024-05-06T13:09:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: [06/May/2024:13:09:19] ENGINE Serving on http://172.21.15.186:8765 2024-05-06T13:09:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: from='client.35420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: [06/May/2024:13:09:19] ENGINE Serving on https://172.21.15.186:7150 2024-05-06T13:09:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: [06/May/2024:13:09:19] ENGINE Bus STARTED 2024-05-06T13:09:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-05-06T13:09:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:19 smithi016 ceph-mon[27395]: Cluster is now healthy 2024-05-06T13:09:20.422 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:09:20.423 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:09:20.858 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:09:21.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:21.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/247639863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:21.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: mgrmap e44: x(active, since 2s), standbys: y 2024-05-06T13:09:21.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2810448165' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/247639863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: mgrmap e44: x(active, since 2s), standbys: y 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:21.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:20 smithi016 ceph-mon[27395]: from='client.? 172.21.15.16:0/2810448165' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:09:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/247639863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: mgrmap e44: x(active, since 2s), standbys: y 2024-05-06T13:09:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: from='client.44157 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:20 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/2810448165' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:09:22.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.369 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:22 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.369 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:22 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.369 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:22 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:22 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:22 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:22.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:22 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:23 smithi186 ceph-mon[23420]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:23.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:23 smithi186 ceph-mon[23420]: mgrmap e45: x(active, since 4s), standbys: y 2024-05-06T13:09:23.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:23 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:23 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:23 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[93192]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:23.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[93192]: mgrmap e45: x(active, since 4s), standbys: y 2024-05-06T13:09:23.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[27395]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:09:23.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[27395]: mgrmap e45: x(active, since 4s), standbys: y 2024-05-06T13:09:23.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:23.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:23 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:24.649 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:09:24] "GET /metrics HTTP/1.1" 200 35519 "" "Prometheus/2.33.4" 2024-05-06T13:09:25.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:25 smithi016 ceph-mon[93192]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-05-06T13:09:25.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:25 smithi016 ceph-mon[93192]: Detected new or changed devices on smithi016 2024-05-06T13:09:25.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:25.322 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:25 smithi016 ceph-mon[27395]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-05-06T13:09:25.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:25 smithi016 ceph-mon[27395]: Detected new or changed devices on smithi016 2024-05-06T13:09:25.323 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:25 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:25.445 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:25 smithi186 ceph-mon[23420]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-05-06T13:09:25.445 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:25 smithi186 ceph-mon[23420]: Detected new or changed devices on smithi016 2024-05-06T13:09:25.445 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:25 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.341 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.341 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.341 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:26 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:26 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.342 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:26 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:26 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:26 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:26.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:26 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:27.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:27 smithi186 ceph-mon[23420]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:09:27.572 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:27 smithi016 ceph-mon[27395]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:09:27.572 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:27 smithi016 ceph-mon[93192]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-06T13:09:29.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:09:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:09:28.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:09:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[93192]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-06T13:09:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[27395]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-06T13:09:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:29 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.279 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:29 smithi186 ceph-mon[23420]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-06T13:09:29.279 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:29 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.280 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:29 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.280 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:29 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.280 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:29 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:29.280 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:29 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: Adjusting osd_memory_target on smithi016 to 2481M 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:09:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:09:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:09:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:09:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:30 smithi186 ceph-mon[23420]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:09:30.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: Adjusting osd_memory_target on smithi016 to 2481M 2024-05-06T13:09:30.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[93192]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: Adjusting osd_memory_target on smithi016 to 2481M 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.conf 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.conf 2024-05-06T13:09:30.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:09:30.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-06T13:09:30.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:30 smithi016 ceph-mon[27395]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:09:31.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:31.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-06T13:09:31.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[93192]: Upgrade: It appears safe to stop mon.c 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:31.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:31.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:31.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-06T13:09:31.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:31 smithi016 ceph-mon[27395]: Upgrade: It appears safe to stop mon.c 2024-05-06T13:09:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-05-06T13:09:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: Updating smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:09:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: Updating smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-06T13:09:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-06T13:09:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:31 smithi186 ceph-mon[23420]: Upgrade: It appears safe to stop mon.c 2024-05-06T13:09:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:32 smithi186 ceph-mon[23420]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-05-06T13:09:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:32 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:32 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:32 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:32 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[93192]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[27395]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-05-06T13:09:32.557 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[27395]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:32.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:32.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:32.558 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:32 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[93192]: Upgrade: Updating mon.c 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[93192]: Deploying daemon mon.c on smithi016 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[93192]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[27395]: Upgrade: Updating mon.c 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[27395]: Deploying daemon mon.c on smithi016 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[27395]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:33.517 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:33 smithi016 ceph-mon[27395]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:33 smithi186 ceph-mon[23420]: Upgrade: Updating mon.c 2024-05-06T13:09:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:33 smithi186 ceph-mon[23420]: Deploying daemon mon.c on smithi016 2024-05-06T13:09:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:33 smithi186 ceph-mon[23420]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-06T13:09:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:33 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:33.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:33 smithi016 systemd[1]: Stopping Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:09:34.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c[27390]: 2024-05-06T13:09:34.003+0000 7f05033cc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:09:34.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c[27390]: 2024-05-06T13:09:34.003+0000 7f05033cc700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-06T13:09:34.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 podman[96796]: 2024-05-06 13:09:34.116932352 +0000 UTC m=+0.239857518 container died ccff3d350519396cde58972c2d08f5e1f9dea71ed4d98f9e0f071eaaa86c120c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, release=754, distribution-scope=public, RELEASE=HEAD, architecture=x86_64, ceph=True, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, version=8) 2024-05-06T13:09:34.647 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 podman[96796]: 2024-05-06 13:09:34.446120632 +0000 UTC m=+0.569045793 container cleanup ccff3d350519396cde58972c2d08f5e1f9dea71ed4d98f9e0f071eaaa86c120c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, RELEASE=HEAD, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, version=8, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, maintainer=Guillaume Abrioux ) 2024-05-06T13:09:34.647 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 bash[96796]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c 2024-05-06T13:09:34.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 podman[96811]: 2024-05-06 13:09:34.647487512 +0000 UTC m=+0.530460413 container remove ccff3d350519396cde58972c2d08f5e1f9dea71ed4d98f9e0f071eaaa86c120c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, vcs-type=git, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, GIT_CLEAN=True, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-05-06T13:09:34.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c.service: Deactivated successfully. 2024-05-06T13:09:34.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 systemd[1]: Stopped Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:09:34.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:34 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c.service: Consumed 12.225s CPU time. 2024-05-06T13:09:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:09:34] "GET /metrics HTTP/1.1" 200 38321 "" "Prometheus/2.33.4" 2024-05-06T13:09:35.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 systemd[1]: Starting Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:09:35.569 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 podman[96946]: 2024-05-06 13:09:35.298482109 +0000 UTC m=+0.104548365 container create 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-06T13:09:35.569 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 podman[96946]: 2024-05-06 13:09:35.212529419 +0000 UTC m=+0.018595646 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:09:35.569 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 podman[96946]: 2024-05-06 13:09:35.542618167 +0000 UTC m=+0.348684390 container init 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-06T13:09:35.569 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 podman[96946]: 2024-05-06 13:09:35.545780346 +0000 UTC m=+0.351846561 container start 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-06T13:09:35.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev), process ceph-mon, pid 2 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: pidfile_write: ignore empty --pid-file 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: load: jerasure load: lrc 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: RocksDB version: 7.9.2 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Git sha 0 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Compile date 2024-05-03 15:08:47 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: DB SUMMARY 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: DB Session ID: 3OQ8ZLL2HZKABVKXDBQV 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: CURRENT file: CURRENT 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1857 Bytes 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000039.sst 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000037.log size: 7001016 ; 2024-05-06T13:09:35.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.error_if_exists: 0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.create_if_missing: 0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.paranoid_checks: 1 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.env: 0x55889d35fc60 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.info_log: 0x55889e14bac0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.statistics: (nil) 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.use_fsync: 0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_log_file_size: 0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T13:09:35.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.allow_fallocate: 1 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.use_direct_reads: 0 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.db_log_dir: 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.wal_dir: 2024-05-06T13:09:35.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T13:09:35.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T13:09:35.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.write_buffer_manager: 0x55889e11e820 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T13:09:35.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.unordered_write: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.row_cache: None 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.wal_filter: None 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.two_write_queues: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.wal_compression: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.atomic_flush: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T13:09:35.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.log_readahead_size: 0 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_background_jobs: 2 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_background_compactions: -1 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_subcompactions: 1 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T13:09:35.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_open_files: -1 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_background_flushes: -1 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Compression algorithms supported: 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T13:09:35.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kZSTD supported: 0 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kXpressCompression supported: 0 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kZlibCompression supported: 1 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kSnappyCompression supported: 1 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kLZ4Compression supported: 1 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: kBZip2Compression supported: 0 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.merge_operator: 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_filter: None 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T13:09:35.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55889e14bbc0) 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: index_type: 0 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: data_block_index_type: 0 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: index_shortening: 1 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: checksum: 4 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: no_block_cache: 0 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache: 0x55889e14f090 2024-05-06T13:09:35.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache_options: 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: capacity : 536870912 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: num_shard_bits : 4 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: strict_capacity_limit : 0 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache_compressed: (nil) 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: persistent_cache: (nil) 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_size: 4096 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_size_deviation: 10 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_restart_interval: 16 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: index_block_restart_interval: 1 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: metadata_block_size: 4096 2024-05-06T13:09:35.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: partition_filters: 0 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: use_delta_encoding: 1 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: filter_policy: bloomfilter 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: whole_key_filtering: 1 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: verify_compression: 0 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: format_version: 5 2024-05-06T13:09:35.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: enable_index_compression: 1 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_align: 0 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: max_auto_readahead_size: 262144 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: prepopulate_block_cache: 0 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: initial_auto_readahead_size: 8192 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression: NoCompression 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.num_levels: 7 2024-05-06T13:09:35.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T13:09:35.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T13:09:35.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T13:09:35.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T13:09:35.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.table_properties_collectors: 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.inplace_update_support: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.bloom_locality: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.max_successive_merges: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.ttl: 2592000 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T13:09:35.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.enable_blob_files: false 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.min_blob_size: 0 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T13:09:35.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 39.sst 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 41, last_sequence is 23228, log_number is 37,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 37 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2aa99b30-98e7-493e-98cd-754cb5498800 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000975576456, "job": 1, "event": "recovery_started", "wal_files": [37]} 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #37 mode 2 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000975594762, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 42, "file_size": 4304720, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 23233, "largest_seqno": 25653, "table_properties": {"data_size": 4295191, "index_size": 5757, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2757, "raw_key_size": 25844, "raw_average_key_size": 23, "raw_value_size": 4273901, "raw_average_value_size": 3906, "num_data_blocks": 257, "num_entries": 1094, "num_filter_entries": 1094, "num_deletions": 1, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715000975, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2aa99b30-98e7-493e-98cd-754cb5498800", "db_session_id": "3OQ8ZLL2HZKABVKXDBQV", "orig_file_number": 42, "seqno_to_time_mapping": "N/A"}} 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000975594881, "job": 1, "event": "recovery_finished"} 2024-05-06T13:09:35.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/version_set.cc:5047] Creating manifest 44 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000037.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55889e240000 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: DB pointer 0x55889e22a000 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** DB Stats ** 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:35.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: L0 1/0 4.11 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 683.9 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: L6 1/0 8.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Sum 2/0 12.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 683.9 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 683.9 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:35.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 683.9 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-05-06T13:09:35.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative compaction: 0.00 GB write, 192.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval compaction: 0.00 GB write, 192.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: Block cache BinnedLRUCache@0x55889e14f090#2 capacity: 512.00 MB usage: 8.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.78 KB,0.000530481%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:35.947 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: starting mon.c rank 1 at public addrs [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] at bind addrs [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???) e3 preinit fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).mds e1 new map 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).mds e1 print_map 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout: e1 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout: legacy client fscid: -1 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout: No filesystems configured 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).osd e114 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:35.948 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 ceph-mon[96965]: mon.c@-1(???).paxosservice(auth 1..26) refresh upgraded, format 0 -> 3 2024-05-06T13:09:35.949 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 bash[96946]: 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 2024-05-06T13:09:35.949 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:35 smithi016 systemd[1]: Started Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:09:36.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:09:36.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: mon.c calling monitor election 2024-05-06T13:09:36.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: mon.a calling monitor election 2024-05-06T13:09:36.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:36.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: monmap epoch 3 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: min_mon_release 17 (quincy) 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: election_strategy: 1 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: fsmap 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: mgrmap e45: x(active, since 18s), standbys: y 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Health detail: HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: [WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:36.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: mon.c calling monitor election 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: mon.a calling monitor election 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: monmap epoch 3 2024-05-06T13:09:36.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: min_mon_release 17 (quincy) 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: election_strategy: 1 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: fsmap 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: mgrmap e45: x(active, since 18s), standbys: y 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Health detail: HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: [WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:09:36.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:36.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:36 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: mon.c calling monitor election 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: mon.a calling monitor election 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: monmap epoch 3 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: min_mon_release 17 (quincy) 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: election_strategy: 1 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: fsmap 2024-05-06T13:09:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: mgrmap e45: x(active, since 18s), standbys: y 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Health detail: HEALTH_WARN 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: [WRN] CEPHADM_AGENT_DOWN: 1 Cephadm Agent(s) are not reporting. Hosts may be offline 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Cephadm agent on host smithi016 has not reported in 60.0 seconds. Agent is assumed down and host may be offline. 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:36 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Cluster is now healthy 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-05-06T13:09:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Cluster is now healthy 2024-05-06T13:09:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:37 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:09:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:09:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:09:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:38 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.135 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.136 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:39.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:38 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:40.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.158 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.161 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:39 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:39 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:40.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:40.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:40.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:40.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:40.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:09:40.604+0000 7f9a35e30700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1019 B/s rd, 0 op/s 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:40 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:41.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:41.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:41 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:42.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:42.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:41 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 888 B/s rd, 0 op/s 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 888 B/s rd, 0 op/s 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.106 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:42 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 888 B/s rd, 0 op/s 2024-05-06T13:09:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:42 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.946 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.947 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:43.948 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:43.949 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:43.949 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:43 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.152 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.155 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.156 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.157 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.159 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:43 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.605 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:09:44] "GET /metrics HTTP/1.1" 200 38321 "" "Prometheus/2.33.4" 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:44.945 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:44 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:45.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:45.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:45.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:45.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:45.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:44 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:46.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:46.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:46.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:45 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 888 B/s rd, 0 op/s 2024-05-06T13:09:47.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.112 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 888 B/s rd, 0 op/s 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.115 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.118 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.120 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.120 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:46 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 888 B/s rd, 0 op/s 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:46 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:47 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:48.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:48.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:48.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:48.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:48.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:48.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:47 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:09:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:09:48.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:09:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:49.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-06T13:09:49.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:48 smithi186 ceph-mon[23420]: Upgrade: It appears safe to stop mon.c 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:49.096 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.097 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[93192]: Upgrade: It appears safe to stop mon.c 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-06T13:09:49.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:48 smithi016 ceph-mon[96965]: Upgrade: It appears safe to stop mon.c 2024-05-06T13:09:50.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:50.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[96965]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:50 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:50 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:09:50.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:50 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:50 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:50.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:50 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.265 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:09:51.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[93192]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:51.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[96965]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:51.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:51 smithi016 ceph-mon[96965]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:51 smithi186 ceph-mon[23420]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:51 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:51 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:51 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:51.984 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:09:51.984 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 0s ago 13m - - 2024-05-06T13:09:51.984 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 6s ago 13m - - 2024-05-06T13:09:51.984 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (3m) 0s ago 8m 25.1M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (3m) 6s ago 8m 52.3M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (2m) 0s ago 7m 52.3M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (2m) 6s ago 12m 498M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (58s) 0s ago 14m 448M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (43s) 0s ago 14m 41.9M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (13m) 6s ago 13m 59.4M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (16s) 0s ago 13m 34.6M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 5283a6b340b1 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (3m) 0s ago 8m 21.4M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (3m) 6s ago 8m 18.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (12m) 0s ago 12m 53.3M 2481M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (12m) 0s ago 12m 55.0M 2481M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:09:51.985 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (11m) 0s ago 11m 50.7M 2481M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:09:51.986 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (11m) 0s ago 11m 52.2M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:09:51.986 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (10m) 6s ago 10m 54.0M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:09:51.986 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (10m) 6s ago 10m 53.6M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:09:51.986 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (10m) 6s ago 10m 50.5M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:09:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (9m) 6s ago 9m 53.5M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:09:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (2m) 6s ago 9m 58.1M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:09:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (7m) 0s ago 7m 74.7M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:09:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (7m) 6s ago 7m 72.9M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:09:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (7m) 0s ago 7m 74.6M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:09:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (7m) 6s ago 7m 72.7M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:09:52.415 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:09:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:09:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-06T13:09:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:09:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:09:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:09:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:09:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:09:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:09:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:09:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:09:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:09:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-06T13:09:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 4 2024-05-06T13:09:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:09:52.418 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:09:52.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:52 smithi016 ceph-mon[96965]: from='client.44169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:52.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:52 smithi016 ceph-mon[96965]: from='client.44175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:52.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:52 smithi016 ceph-mon[93192]: from='client.44169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:52.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:52 smithi016 ceph-mon[93192]: from='client.44175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:52 smithi186 ceph-mon[23420]: from='client.44169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:52 smithi186 ceph-mon[23420]: from='client.44175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "4/23 daemons upgraded", 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mon daemons", 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:09:52.772 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:09:53.200 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:09:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: Upgrade: Updating mon.c 2024-05-06T13:09:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: Deploying daemon mon.c on smithi016 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1796061469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4076775255' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: Upgrade: Updating mon.c 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:53.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: Deploying daemon mon.c on smithi016 2024-05-06T13:09:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='client.? 172.21.15.16:0/1796061469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:53 smithi016 ceph-mon[96965]: from='client.? 172.21.15.16:0/4076775255' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:09:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: Upgrade: Updating mon.c 2024-05-06T13:09:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:09:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:09:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: Deploying daemon mon.c on smithi016 2024-05-06T13:09:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/1796061469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:09:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:53 smithi186 ceph-mon[23420]: from='client.? 172.21.15.16:0/4076775255' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:09:54.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 systemd[1]: Stopping Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:09:54.646 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c[96961]: 2024-05-06T13:09:54.335+0000 7fe440adc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:09:54.646 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c[96961]: 2024-05-06T13:09:54.335+0000 7fe440adc700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-06T13:09:54.647 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 podman[102498]: 2024-05-06 13:09:54.357096678 +0000 UTC m=+0.134563380 container died 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:09:54.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 podman[102498]: 2024-05-06 13:09:54.736047473 +0000 UTC m=+0.513514192 container cleanup 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:09:54.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 bash[102498]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c 2024-05-06T13:09:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:09:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:09:54] "GET /metrics HTTP/1.1" 200 38332 "" "Prometheus/2.33.4" 2024-05-06T13:09:55.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:54 smithi016 podman[102510]: 2024-05-06 13:09:54.96216756 +0000 UTC m=+0.609145844 container remove 5283a6b340b10faf11cf7bcc5c07035269f6e1d1da0f61b213bb75826413f623 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-06T13:09:55.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c.service: Deactivated successfully. 2024-05-06T13:09:55.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 systemd[1]: Stopped Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:09:55.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c.service: Consumed 1.411s CPU time. 2024-05-06T13:09:55.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 systemd[1]: Starting Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:09:55.611 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 podman[102650]: 2024-05-06 13:09:55.529953387 +0000 UTC m=+0.110605861 container create d76a93ae994572ffc9020fba71373053d5c6d4a23a7c0f51a2db6f20616015c7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-06T13:09:55.612 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 podman[102650]: 2024-05-06 13:09:55.437827829 +0000 UTC m=+0.018480318 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:09:55.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 podman[102650]: 2024-05-06 13:09:55.691455745 +0000 UTC m=+0.272108220 container init d76a93ae994572ffc9020fba71373053d5c6d4a23a7c0f51a2db6f20616015c7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 podman[102650]: 2024-05-06 13:09:55.694977018 +0000 UTC m=+0.275629496 container start d76a93ae994572ffc9020fba71373053d5c6d4a23a7c0f51a2db6f20616015c7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev), process ceph-mon, pid 2 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: pidfile_write: ignore empty --pid-file 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: load: jerasure load: lrc 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: RocksDB version: 7.9.2 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Git sha 0 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Compile date 2024-05-03 15:08:47 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: DB SUMMARY 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: DB Session ID: EDOKPEUF4CTXJZHKQ7G4 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: CURRENT file: CURRENT 2024-05-06T13:09:55.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: MANIFEST file: MANIFEST-000044 size: 517 Bytes 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000049.sst 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000047.log size: 1951797 ; 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.error_if_exists: 0 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.create_if_missing: 0 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.paranoid_checks: 1 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.env: 0x562e260d1c60 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.info_log: 0x562e279e7ac0 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T13:09:55.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.statistics: (nil) 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.use_fsync: 0 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_log_file_size: 0 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.allow_fallocate: 1 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T13:09:55.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.use_direct_reads: 0 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.db_log_dir: 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.wal_dir: 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.write_buffer_manager: 0x562e279ba820 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T13:09:55.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.unordered_write: 0 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.row_cache: None 2024-05-06T13:09:55.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.wal_filter: None 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.two_write_queues: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.wal_compression: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.atomic_flush: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.log_readahead_size: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T13:09:55.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_background_jobs: 2 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_background_compactions: -1 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_subcompactions: 1 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_open_files: -1 2024-05-06T13:09:55.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_background_flushes: -1 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Compression algorithms supported: 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kZSTD supported: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kXpressCompression supported: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kZlibCompression supported: 1 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kSnappyCompression supported: 1 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kLZ4Compression supported: 1 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: kBZip2Compression supported: 0 2024-05-06T13:09:55.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000044 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.merge_operator: 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_filter: None 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562e279e7bc0) 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T13:09:55.933 INFO:journalctl@ceph.mon.c.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: index_type: 0 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: data_block_index_type: 0 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: index_shortening: 1 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: checksum: 4 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: no_block_cache: 0 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache: 0x562e279eb090 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache_options: 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: capacity : 536870912 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: num_shard_bits : 4 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: strict_capacity_limit : 0 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-05-06T13:09:55.934 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_cache_compressed: (nil) 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: persistent_cache: (nil) 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_size: 4096 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_size_deviation: 10 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_restart_interval: 16 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: index_block_restart_interval: 1 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: metadata_block_size: 4096 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: partition_filters: 0 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: use_delta_encoding: 1 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: filter_policy: bloomfilter 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: whole_key_filtering: 1 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: verify_compression: 0 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: format_version: 5 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: enable_index_compression: 1 2024-05-06T13:09:55.935 INFO:journalctl@ceph.mon.c.smithi016.stdout: block_align: 0 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: max_auto_readahead_size: 262144 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: prepopulate_block_cache: 0 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: initial_auto_readahead_size: 8192 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression: NoCompression 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.num_levels: 7 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T13:09:55.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:09:55.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T13:09:55.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T13:09:55.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.table_properties_collectors: 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.inplace_update_support: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.bloom_locality: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.max_successive_merges: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T13:09:55.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.ttl: 2592000 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.enable_blob_files: false 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.min_blob_size: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T13:09:55.941 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000044 succeeded,manifest_file_number is 44, next_file_number is 51, last_sequence is 25971, log_number is 47,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 47 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 47 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2aa99b30-98e7-493e-98cd-754cb5498800 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000995725075, "job": 1, "event": "recovery_started", "wal_files": [47]} 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #47 mode 2 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000995731570, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 52, "file_size": 1235013, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 25976, "largest_seqno": 27963, "table_properties": {"data_size": 1228306, "index_size": 2940, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2757, "raw_key_size": 26778, "raw_average_key_size": 24, "raw_value_size": 1210451, "raw_average_value_size": 1106, "num_data_blocks": 119, "num_entries": 1094, "num_filter_entries": 1094, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715000995, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2aa99b30-98e7-493e-98cd-754cb5498800", "db_session_id": "EDOKPEUF4CTXJZHKQ7G4", "orig_file_number": 52, "seqno_to_time_mapping": "N/A"}} 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715000995731674, "job": 1, "event": "recovery_finished"} 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/version_set.cc:5047] Creating manifest 54 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000047.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562e27adc000 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: DB pointer 0x562e27ac6000 2024-05-06T13:09:55.942 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** DB Stats ** 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: L0 1/0 1.18 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 387.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-06T13:09:55.943 INFO:journalctl@ceph.mon.c.smithi016.stdout: L6 1/0 11.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Sum 2/0 12.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 387.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 387.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** Compaction Stats [default] ** 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 387.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T13:09:55.944 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Cumulative compaction: 0.00 GB write, 133.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Interval compaction: 0.00 GB write, 133.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Block cache BinnedLRUCache@0x562e279eb090#2 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.78 KB,0.000530481%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: starting mon.c rank 1 at public addrs [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] at bind addrs [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???) e3 preinit fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).mds e1 new map 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).mds e1 print_map 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: e1 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T13:09:55.945 INFO:journalctl@ceph.mon.c.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: legacy client fscid: -1 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout: No filesystems configured 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).osd e114 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: mon.c@-1(???).paxosservice(auth 1..27) refresh upgraded, format 0 -> 3 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 bash[102650]: d76a93ae994572ffc9020fba71373053d5c6d4a23a7c0f51a2db6f20616015c7 2024-05-06T13:09:55.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 systemd[1]: Started Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:09:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:55 smithi186 ceph-mon[23420]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:56.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[93192]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:56.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:55 smithi016 ceph-mon[102669]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: mon.c calling monitor election 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: mon.a calling monitor election 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: monmap epoch 3 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: min_mon_release 17 (quincy) 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: election_strategy: 1 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:57.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: fsmap 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: mgrmap e45: x(active, since 38s), standbys: y 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: overall HEALTH_OK 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.010 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.011 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: mon.c calling monitor election 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: mon.a calling monitor election 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: monmap epoch 3 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: min_mon_release 17 (quincy) 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: election_strategy: 1 2024-05-06T13:09:57.012 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: fsmap 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: mgrmap e45: x(active, since 38s), standbys: y 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: overall HEALTH_OK 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.013 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.014 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.015 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.016 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: mon.c calling monitor election 2024-05-06T13:09:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: mon.a calling monitor election 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: monmap epoch 3 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: last_changed 2024-05-06T12:56:45.274116+0000 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: min_mon_release 17 (quincy) 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: election_strategy: 1 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: fsmap 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: mgrmap e45: x(active, since 38s), standbys: y 2024-05-06T13:09:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: overall HEALTH_OK 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:57.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:56 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:57 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.359 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.362 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.365 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:58.366 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:58.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:58.367 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:58.957 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:09:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:09:58.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:09:59.095 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.095 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:59.095 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.095 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.095 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.096 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.097 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.098 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.098 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:59.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.105 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.106 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:09:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:09:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:09:59.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:58 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:09:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:09:59 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: overall HEALTH_OK 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: overall HEALTH_OK 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: overall HEALTH_OK 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:01.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:01.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:01.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:00 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.110 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.115 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:02.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:01 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.243 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.243 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:03.243 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.244 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.247 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.248 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:03.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:03.254 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:03.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:03.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:02 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:04.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:04.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:04.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:04.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:03 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:04.963 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:10:04] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.33.4" 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.215 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.216 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.217 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.218 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.221 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:05.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:05.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:04 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:05 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:06.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:07.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:06 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:07.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:07.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:07.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:07.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:07.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:07.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:07.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:07 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.273 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.274 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.276 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.277 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.278 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.279 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.280 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.281 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.282 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:08.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:08.969 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:08.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-05-06T13:10:09.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[102669]: Upgrade: It appears safe to stop mon.b 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.133 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:10:09.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-05-06T13:10:09.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:08 smithi016 ceph-mon[93192]: Upgrade: It appears safe to stop mon.b 2024-05-06T13:10:09.259 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.259 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.260 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:09.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:09.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:09.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-06T13:10:09.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-05-06T13:10:09.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:08 smithi186 ceph-mon[23420]: Upgrade: It appears safe to stop mon.b 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:10 smithi186 ceph-mon[23420]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:10.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:10.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:10.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:10.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:10.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:11.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:11 smithi186 ceph-mon[23420]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:11.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:11 smithi186 ceph-mon[23420]: Upgrade: Updating mon.b 2024-05-06T13:10:11.659 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:11 smithi186 ceph-mon[23420]: Deploying daemon mon.b on smithi186 2024-05-06T13:10:11.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:11 smithi016 ceph-mon[93192]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:11.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:11 smithi016 ceph-mon[93192]: Upgrade: Updating mon.b 2024-05-06T13:10:11.664 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:11 smithi016 ceph-mon[93192]: Deploying daemon mon.b on smithi186 2024-05-06T13:10:11.664 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:11 smithi016 ceph-mon[102669]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:11.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:11 smithi016 ceph-mon[102669]: Upgrade: Updating mon.b 2024-05-06T13:10:11.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:11 smithi016 ceph-mon[102669]: Deploying daemon mon.b on smithi186 2024-05-06T13:10:12.466 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:12 smithi186 systemd[1]: Stopping Ceph mon.b for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:10:12.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:10:12] ENGINE Bus STOPPING 2024-05-06T13:10:12.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:10:12] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:10:12.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:10:12] ENGINE Bus STOPPED 2024-05-06T13:10:12.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:10:12] ENGINE Bus STARTING 2024-05-06T13:10:12.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:10:12] ENGINE Serving on http://:::9283 2024-05-06T13:10:12.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:10:12] ENGINE Bus STARTED 2024-05-06T13:10:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b[23416]: 2024-05-06T13:10:12.465+0000 7fb7c12a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:10:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b[23416]: 2024-05-06T13:10:12.465+0000 7fb7c12a2700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-06T13:10:12.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:12 smithi186 podman[83457]: 2024-05-06 13:10:12.58876496 +0000 UTC m=+0.231546136 container died f9bbd127572aaccebafca6f6086be529d0c276a15247770363a31e537c3d836c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, release=754, vendor=Red Hat, Inc., vcs-type=git, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0) 2024-05-06T13:10:13.216 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:12 smithi186 podman[83457]: 2024-05-06 13:10:12.998523078 +0000 UTC m=+0.641304260 container cleanup f9bbd127572aaccebafca6f6086be529d0c276a15247770363a31e537c3d836c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, RELEASE=HEAD, ceph=True, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8) 2024-05-06T13:10:13.216 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:12 smithi186 bash[83457]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b 2024-05-06T13:10:13.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 podman[83482]: 2024-05-06 13:10:13.216474223 +0000 UTC m=+0.624848289 container remove f9bbd127572aaccebafca6f6086be529d0c276a15247770363a31e537c3d836c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, vcs-type=git, build-date=2022-05-03T08:36:31.336870, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T13:10:13.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.b.service: Deactivated successfully. 2024-05-06T13:10:13.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 systemd[1]: Stopped Ceph mon.b for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:10:13.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.b.service: Consumed 15.191s CPU time. 2024-05-06T13:10:13.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 systemd[1]: Starting Ceph mon.b for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:10:13.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 podman[83610]: 2024-05-06 13:10:13.647908764 +0000 UTC m=+0.018222590 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:10:13.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:13 smithi186 podman[83610]: 2024-05-06 13:10:13.760283513 +0000 UTC m=+0.130597382 container create 320fce626ef76ed9a5e06cac18b5b95bbb00d0c8a7c87509c95c7155961be950 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 podman[83610]: 2024-05-06 13:10:14.062829195 +0000 UTC m=+0.433143021 container init 320fce626ef76ed9a5e06cac18b5b95bbb00d0c8a7c87509c95c7155961be950 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 podman[83610]: 2024-05-06 13:10:14.065855952 +0000 UTC m=+0.436169783 container start 320fce626ef76ed9a5e06cac18b5b95bbb00d0c8a7c87509c95c7155961be950 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: set uid:gid to 167:167 (ceph:ceph) 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev), process ceph-mon, pid 2 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: pidfile_write: ignore empty --pid-file 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: load: jerasure load: lrc 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: RocksDB version: 7.9.2 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Git sha 0 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Compile date 2024-05-03 15:08:47 2024-05-06T13:10:14.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: DB SUMMARY 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: DB Session ID: PQMKU0AHNJ4U35CDVXV8 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: CURRENT file: CURRENT 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: IDENTITY file: IDENTITY 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: MANIFEST file: MANIFEST-000009 size: 2238 Bytes 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000045.sst 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000043.log size: 896796 ; 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.error_if_exists: 0 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.create_if_missing: 0 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.paranoid_checks: 1 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.env: 0x561b9bf97c60 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.fs: PosixFileSystem 2024-05-06T13:10:14.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.info_log: 0x561b9e40dac0 2024-05-06T13:10:14.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_file_opening_threads: 16 2024-05-06T13:10:14.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.statistics: (nil) 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.use_fsync: 0 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_log_file_size: 0 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.keep_log_file_num: 1000 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.recycle_log_file_num: 0 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.allow_fallocate: 1 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.allow_mmap_reads: 0 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.allow_mmap_writes: 0 2024-05-06T13:10:14.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.use_direct_reads: 0 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.create_missing_column_families: 0 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.db_log_dir: 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.wal_dir: 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.advise_random_on_open: 1 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.db_write_buffer_size: 0 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.write_buffer_manager: 0x561b9e3e0820 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-06T13:10:14.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.rate_limiter: (nil) 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.wal_recovery_mode: 2 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.enable_thread_tracking: 0 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.enable_pipelined_write: 0 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.unordered_write: 0 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.row_cache: None 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.wal_filter: None 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-06T13:10:14.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.allow_ingest_behind: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.two_write_queues: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.manual_wal_flush: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.wal_compression: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.atomic_flush: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.log_readahead_size: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.best_efforts_recovery: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.allow_data_in_errors: 0 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.db_host_id: __hostname__ 2024-05-06T13:10:14.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_background_jobs: 2 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_background_compactions: -1 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_subcompactions: 1 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_total_wal_size: 0 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_open_files: -1 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bytes_per_sync: 0 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-06T13:10:14.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_readahead_size: 0 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_background_flushes: -1 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Compression algorithms supported: 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kZSTD supported: 0 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kXpressCompression supported: 0 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kLZ4HCCompression supported: 1 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kZlibCompression supported: 1 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kSnappyCompression supported: 1 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kLZ4Compression supported: 1 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: kBZip2Compression supported: 0 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-05-06T13:10:14.524 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.merge_operator: 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_filter: None 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_filter_factory: None 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.sst_partitioner_factory: None 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561b9e40dbc0) 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: cache_index_and_filter_blocks: 1 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: pin_top_level_index_and_filter: 1 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: index_type: 0 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: data_block_index_type: 0 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: index_shortening: 1 2024-05-06T13:10:14.525 INFO:journalctl@ceph.mon.b.smithi186.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: checksum: 4 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: no_block_cache: 0 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_cache: 0x561b9e411090 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_cache_name: BinnedLRUCache 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_cache_options: 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: capacity : 536870912 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: num_shard_bits : 4 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: strict_capacity_limit : 0 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: high_pri_pool_ratio: 0.000 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_cache_compressed: (nil) 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: persistent_cache: (nil) 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_size: 4096 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_size_deviation: 10 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_restart_interval: 16 2024-05-06T13:10:14.526 INFO:journalctl@ceph.mon.b.smithi186.stdout: index_block_restart_interval: 1 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: metadata_block_size: 4096 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: partition_filters: 0 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: use_delta_encoding: 1 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: filter_policy: bloomfilter 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: whole_key_filtering: 1 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: verify_compression: 0 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: read_amp_bytes_per_bit: 0 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: format_version: 5 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: enable_index_compression: 1 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: block_align: 0 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: max_auto_readahead_size: 262144 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: prepopulate_block_cache: 0 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: initial_auto_readahead_size: 8192 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout: num_file_reads_for_auto_readahead: 2 2024-05-06T13:10:14.527 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.write_buffer_size: 33554432 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_write_buffer_number: 2 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression: NoCompression 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression: Disabled 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.prefix_extractor: nullptr 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.num_levels: 7 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-06T13:10:14.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.level: 32767 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.strategy: 0 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.enabled: false 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-06T13:10:14.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.target_file_size_base: 67108864 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-06T13:10:14.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.arena_block_size: 1048576 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.disable_auto_compactions: 0 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.table_properties_collectors: 2024-05-06T13:10:14.531 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.inplace_update_support: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.bloom_locality: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.max_successive_merges: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.paranoid_file_checks: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.force_consistency_checks: 1 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.report_bg_io_stats: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.ttl: 2592000 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-06T13:10:14.532 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.enable_blob_files: false 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.min_blob_size: 0 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.blob_file_size: 268435456 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.blob_file_starting_level: 0 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 45.sst 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 47, last_sequence is 29605, log_number is 43,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 43 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7239d515-c991-44dc-8930-4d839d2c82ad 2024-05-06T13:10:14.533 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715001014096851, "job": 1, "event": "recovery_started", "wal_files": [43]} 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #43 mode 2 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715001014101170, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 48, "file_size": 569244, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 29610, "largest_seqno": 30392, "table_properties": {"data_size": 565754, "index_size": 1388, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1093, "raw_key_size": 10666, "raw_average_key_size": 24, "raw_value_size": 558320, "raw_average_value_size": 1298, "num_data_blocks": 55, "num_entries": 430, "num_filter_entries": 430, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715001014, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7239d515-c991-44dc-8930-4d839d2c82ad", "db_session_id": "PQMKU0AHNJ4U35CDVXV8", "orig_file_number": 48, "seqno_to_time_mapping": "N/A"}} 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715001014101293, "job": 1, "event": "recovery_finished"} 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/version_set.cc:5047] Creating manifest 50 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000043.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561b9e502000 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: DB pointer 0x561b9e4ec000 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout: ** DB Stats ** 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-06T13:10:14.534 INFO:journalctl@ceph.mon.b.smithi186.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: ** Compaction Stats [default] ** 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: L0 1/0 555.90 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 236.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: L6 1/0 11.67 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Sum 2/0 12.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 236.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 236.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: ** Compaction Stats [default] ** 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-06T13:10:14.535 INFO:journalctl@ceph.mon.b.smithi186.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 236.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Cumulative compaction: 0.00 GB write, 77.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Interval compaction: 0.00 GB write, 77.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Block cache BinnedLRUCache@0x561b9e411090#2 capacity: 512.00 MB usage: 2.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-06T13:10:14.536 INFO:journalctl@ceph.mon.b.smithi186.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,1.45 KB,0.000277162%) Misc(1,0.00 KB,0%) 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: starting mon.b rank 2 at public addrs [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] at bind addrs [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???) e3 preinit fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).mds e1 new map 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).mds e1 print_map 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: e1 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: legacy client fscid: -1 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout: No filesystems configured 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).osd e114 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:10:14.537 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:10:14.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-06T13:10:14.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 ceph-mon[83629]: mon.b@-1(???).paxosservice(auth 1..28) refresh upgraded, format 0 -> 3 2024-05-06T13:10:14.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 bash[83610]: 320fce626ef76ed9a5e06cac18b5b95bbb00d0c8a7c87509c95c7155961be950 2024-05-06T13:10:14.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:14 smithi186 systemd[1]: Started Ceph mon.b for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:10:15.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:10:14] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.33.4" 2024-05-06T13:10:19.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:18.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:10:24.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:10:24.111+0000 7f9a35e30700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-06T13:10:24.868 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:10:24] "GET /metrics HTTP/1.1" 200 38328 "" "Prometheus/2.33.4" 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: fsmap 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mgrmap e45: x(active, since 62s), standbys: y 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.a calling monitor election 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.c calling monitor election 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.b calling monitor election 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:10:26.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Reconfiguring mon.a (monmap changed)... 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.a calling monitor election 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.c calling monitor election 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: monmap epoch 4 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:10:26.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: last_changed 2024-05-06T13:10:20.723974+0000 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: min_mon_release 19 (squid) 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: election_strategy: 1 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: fsmap 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: mgrmap e45: x(active, since 67s), standbys: y 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:10:26.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: Reconfiguring daemon mon.a on smithi016 2024-05-06T13:10:26.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: overall HEALTH_OK 2024-05-06T13:10:26.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:26.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: fsmap 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mgrmap e45: x(active, since 62s), standbys: y 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.a calling monitor election 2024-05-06T13:10:26.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.c calling monitor election 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.b calling monitor election 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Reconfiguring mon.a (monmap changed)... 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.a calling monitor election 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.c calling monitor election 2024-05-06T13:10:26.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: monmap epoch 4 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: last_changed 2024-05-06T13:10:20.723974+0000 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: min_mon_release 19 (squid) 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: election_strategy: 1 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: fsmap 2024-05-06T13:10:26.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: mgrmap e45: x(active, since 67s), standbys: y 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: Reconfiguring daemon mon.a on smithi016 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: overall HEALTH_OK 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: fsmap 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mgrmap e45: x(active, since 62s), standbys: y 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T13:10:26.131 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.a calling monitor election 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.c calling monitor election 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.b calling monitor election 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Reconfiguring mon.a (monmap changed)... 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-06T13:10:26.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.b (rank 2) addr [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] is down (out of quorum) 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.a calling monitor election 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.c calling monitor election 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: monmap epoch 4 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: fsid c6d11770-0ba7-11ef-bc97-c7b262605968 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: last_changed 2024-05-06T13:10:20.723974+0000 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: created 2024-05-06T12:55:06.791929+0000 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: min_mon_release 19 (squid) 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: election_strategy: 1 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: 1: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: 2: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:26.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: fsmap 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: osdmap e114: 8 total, 8 up, 8 in 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: mgrmap e45: x(active, since 67s), standbys: y 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: Reconfiguring daemon mon.a on smithi016 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: overall HEALTH_OK 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:26.586 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:10:27.304 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:10:27.305 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 17s ago 14m - - 2024-05-06T13:10:27.305 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 1s ago 14m - - 2024-05-06T13:10:27.305 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (4m) 17s ago 8m 25.1M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:10:27.305 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (3m) 1s ago 8m 52.3M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:10:27.305 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (2m) 17s ago 7m 52.4M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:10:27.306 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (3m) 1s ago 13m 503M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:10:27.306 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (94s) 17s ago 15m 449M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:10:27.306 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (78s) 17s ago 15m 44.7M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:10:27.306 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (13m) 1s ago 13m 61.5M 2048M 17.2.0 e1d6a67b021e f9bbd127572a 2024-05-06T13:10:27.306 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (31s) 17s ago 13m 33.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (4m) 17s ago 9m 21.6M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (3m) 1s ago 9m 18.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (13m) 17s ago 13m 53.3M 2481M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (12m) 17s ago 12m 55.1M 2481M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (12m) 17s ago 12m 50.9M 2481M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (11m) 17s ago 11m 52.3M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (11m) 1s ago 11m 54.1M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (11m) 1s ago 11m 53.7M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:10:27.307 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (10m) 1s ago 10m 50.5M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:10:27.308 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (10m) 1s ago 10m 53.6M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:10:27.308 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (2m) 1s ago 9m 62.1M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:10:27.308 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (8m) 17s ago 8m 74.8M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:10:27.308 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (8m) 1s ago 8m 72.9M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:10:27.308 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (7m) 17s ago 7m 74.6M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:10:27.308 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (7m) 1s ago 7m 72.8M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:10:27.725 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 5 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:10:27.726 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:10:27.980 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='client.44205 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4283162268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:27.981 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='client.44205 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:27.982 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:27 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/4283162268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:28.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:28.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='client.44205 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:10:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:27 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/4283162268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "4/23 daemons upgraded", 2024-05-06T13:10:28.083 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mon daemons", 2024-05-06T13:10:28.084 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:10:28.084 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:10:28.507 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:10:28.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[93192]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[93192]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[93192]: Reconfiguring mgr.y (monmap changed)... 2024-05-06T13:10:28.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[93192]: Reconfiguring daemon mgr.y on smithi016 2024-05-06T13:10:28.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2683426874' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:10:28.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[102669]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[102669]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[102669]: Reconfiguring mgr.y (monmap changed)... 2024-05-06T13:10:28.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[102669]: Reconfiguring daemon mgr.y on smithi016 2024-05-06T13:10:28.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:28 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2683426874' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:10:28.959 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:28.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:10:28.959 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:28 smithi186 ceph-mon[83629]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.959 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:28 smithi186 ceph-mon[83629]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:28.959 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:28 smithi186 ceph-mon[83629]: Reconfiguring mgr.y (monmap changed)... 2024-05-06T13:10:28.960 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:28 smithi186 ceph-mon[83629]: Reconfiguring daemon mgr.y on smithi016 2024-05-06T13:10:28.960 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:28 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2683426874' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:10:29.886 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='client.44229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.887 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='client.44229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:29.888 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:29.889 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='client.44229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:30.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.515 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:30.086Z caller=alerting.go:353 level=warn component="rule manager" alert="unsupported value type" msg="Expanding alert template failed" err="error executing template __alert_CephMonDown: template: __alert_CephMonDown:1:427: executing \"__alert_CephMonDown\" at : error calling query: found duplicate series for the match group {ceph_daemon=\"mon.a\"} on the right hand-side of the operation: [{ceph_daemon=\"mon.a\", ceph_version=\"ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", public_addr=\"172.21.15.16\", rank=\"0\"}, {ceph_daemon=\"mon.a\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", public_addr=\"172.21.15.16\", rank=\"0\"}];many-to-many matching not allowed: matching labels must be unique on one side" data="unsupported value type" 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: Reconfiguring mon.c (monmap changed)... 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: Reconfiguring daemon mon.c on smithi016 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:10:30.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: Reconfiguring mon.c (monmap changed)... 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: Reconfiguring daemon mon.c on smithi016 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:10:30.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: Reconfiguring mon.c (monmap changed)... 2024-05-06T13:10:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: Reconfiguring daemon mon.c on smithi016 2024-05-06T13:10:31.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:10:31.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:31.793 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:31 smithi016 ceph-mon[93192]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:31.793 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:31 smithi016 ceph-mon[93192]: Reconfiguring osd.0 (monmap changed)... 2024-05-06T13:10:31.793 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:31 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.0 on smithi016 2024-05-06T13:10:31.793 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:31 smithi016 ceph-mon[102669]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:31.793 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:31 smithi016 ceph-mon[102669]: Reconfiguring osd.0 (monmap changed)... 2024-05-06T13:10:31.793 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:31 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.0 on smithi016 2024-05-06T13:10:32.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:31 smithi186 ceph-mon[83629]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:32.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:31 smithi186 ceph-mon[83629]: Reconfiguring osd.0 (monmap changed)... 2024-05-06T13:10:32.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:31 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.0 on smithi016 2024-05-06T13:10:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:33 smithi186 ceph-mon[83629]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:10:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:34.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[93192]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:34.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:34.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:34.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:34.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:10:34.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:34.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[102669]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:34.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:34.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:34.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:34.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:10:34.117 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:34 smithi186 ceph-mon[83629]: Reconfiguring osd.1 (monmap changed)... 2024-05-06T13:10:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:34 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.1 on smithi016 2024-05-06T13:10:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:10:34] "GET /metrics HTTP/1.1" 200 38336 "" "Prometheus/2.33.4" 2024-05-06T13:10:35.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:34 smithi016 ceph-mon[93192]: Reconfiguring osd.1 (monmap changed)... 2024-05-06T13:10:35.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:34 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.1 on smithi016 2024-05-06T13:10:35.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:34 smithi016 ceph-mon[102669]: Reconfiguring osd.1 (monmap changed)... 2024-05-06T13:10:35.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:34 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.1 on smithi016 2024-05-06T13:10:36.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[93192]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:36.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:36.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:36.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:10:36.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:36.093 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[102669]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:36.093 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:36.093 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:36.093 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:10:36.093 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:36.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:35 smithi186 ceph-mon[83629]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:36.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:36.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:36.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:10:36.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:37.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:36 smithi016 ceph-mon[93192]: Reconfiguring osd.2 (monmap changed)... 2024-05-06T13:10:37.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:36 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.2 on smithi016 2024-05-06T13:10:37.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:36 smithi016 ceph-mon[102669]: Reconfiguring osd.2 (monmap changed)... 2024-05-06T13:10:37.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:36 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.2 on smithi016 2024-05-06T13:10:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:36 smithi186 ceph-mon[83629]: Reconfiguring osd.2 (monmap changed)... 2024-05-06T13:10:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:36 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.2 on smithi016 2024-05-06T13:10:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[93192]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:10:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[102669]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:10:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:37 smithi186 ceph-mon[83629]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:10:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:39.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:10:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: Reconfiguring osd.3 (monmap changed)... 2024-05-06T13:10:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.3 on smithi016 2024-05-06T13:10:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: Reconfiguring osd.3 (monmap changed)... 2024-05-06T13:10:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.3 on smithi016 2024-05-06T13:10:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: Reconfiguring osd.3 (monmap changed)... 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.3 on smithi016 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:39.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:39 smithi016 ceph-mon[93192]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:39.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:39 smithi016 ceph-mon[93192]: Reconfiguring rgw.foo.smithi016.pgdorv (monmap changed)... 2024-05-06T13:10:39.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:39 smithi016 ceph-mon[93192]: Reconfiguring daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:10:39.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:39 smithi016 ceph-mon[102669]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:39.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:39 smithi016 ceph-mon[102669]: Reconfiguring rgw.foo.smithi016.pgdorv (monmap changed)... 2024-05-06T13:10:39.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:39 smithi016 ceph-mon[102669]: Reconfiguring daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:10:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:39 smithi186 ceph-mon[83629]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:39 smithi186 ceph-mon[83629]: Reconfiguring rgw.foo.smithi016.pgdorv (monmap changed)... 2024-05-06T13:10:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:39 smithi186 ceph-mon[83629]: Reconfiguring daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:10:41.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:41.132 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:42.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:41 smithi016 ceph-mon[93192]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:42.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:41 smithi016 ceph-mon[93192]: Reconfiguring rgw.smpl.smithi016.rbmnkc (monmap changed)... 2024-05-06T13:10:42.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:41 smithi016 ceph-mon[93192]: Reconfiguring daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:10:42.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:41 smithi016 ceph-mon[102669]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:42.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:41 smithi016 ceph-mon[102669]: Reconfiguring rgw.smpl.smithi016.rbmnkc (monmap changed)... 2024-05-06T13:10:42.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:41 smithi016 ceph-mon[102669]: Reconfiguring daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:10:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:41 smithi186 ceph-mon[83629]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:41 smithi186 ceph-mon[83629]: Reconfiguring rgw.smpl.smithi016.rbmnkc (monmap changed)... 2024-05-06T13:10:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:41 smithi186 ceph-mon[83629]: Reconfiguring daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:10:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: Reconfiguring mon.b (monmap changed)... 2024-05-06T13:10:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:43.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:43 smithi186 ceph-mon[83629]: Reconfiguring daemon mon.b on smithi186 2024-05-06T13:10:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: Reconfiguring mon.b (monmap changed)... 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[93192]: Reconfiguring daemon mon.b on smithi186 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: Reconfiguring mon.b (monmap changed)... 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-06T13:10:43.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:43.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:43 smithi016 ceph-mon[102669]: Reconfiguring daemon mon.b on smithi186 2024-05-06T13:10:44.705 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:10:44] "GET /metrics HTTP/1.1" 200 38336 "" "Prometheus/2.33.4" 2024-05-06T13:10:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:10:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-06T13:10:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:45.865 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:45 smithi186 ceph-mon[83629]: Reconfiguring mgr.x (monmap changed)... 2024-05-06T13:10:45.865 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:45 smithi186 ceph-mon[83629]: Reconfiguring daemon mgr.x on smithi186 2024-05-06T13:10:45.865 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:45 smithi186 ceph-mon[83629]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:45 smithi016 ceph-mon[93192]: Reconfiguring mgr.x (monmap changed)... 2024-05-06T13:10:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:45 smithi016 ceph-mon[93192]: Reconfiguring daemon mgr.x on smithi186 2024-05-06T13:10:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:45 smithi016 ceph-mon[93192]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:46.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:45 smithi016 ceph-mon[102669]: Reconfiguring mgr.x (monmap changed)... 2024-05-06T13:10:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:45 smithi016 ceph-mon[102669]: Reconfiguring daemon mgr.x on smithi186 2024-05-06T13:10:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:45 smithi016 ceph-mon[102669]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: Reconfiguring osd.4 (monmap changed)... 2024-05-06T13:10:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:10:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:46 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.4 on smithi186 2024-05-06T13:10:47.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: Reconfiguring osd.4 (monmap changed)... 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.4 on smithi186 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:47.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: Reconfiguring osd.4 (monmap changed)... 2024-05-06T13:10:47.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:10:47.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:47.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:46 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.4 on smithi186 2024-05-06T13:10:48.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:48.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:48.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:10:48.906 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:48.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:10:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:48 smithi016 ceph-mon[93192]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:48 smithi016 ceph-mon[102669]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:48 smithi186 ceph-mon[83629]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: Reconfiguring osd.5 (monmap changed)... 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.5 on smithi186 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.091 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: Reconfiguring osd.5 (monmap changed)... 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.5 on smithi186 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.092 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.093 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.093 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:10:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: Reconfiguring osd.5 (monmap changed)... 2024-05-06T13:10:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:10:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.5 on smithi186 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:50.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:51 smithi186 ceph-mon[83629]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:10:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:52.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[93192]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:52.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.098 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[102669]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:10:52.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:53.148 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:52 smithi186 ceph-mon[83629]: Reconfiguring osd.6 (monmap changed)... 2024-05-06T13:10:53.148 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:52 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.6 on smithi186 2024-05-06T13:10:53.148 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:53.149 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:53.149 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T13:10:53.149 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[93192]: Reconfiguring osd.6 (monmap changed)... 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.6 on smithi186 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[102669]: Reconfiguring osd.6 (monmap changed)... 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.6 on smithi186 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T13:10:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:54.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:53 smithi016 ceph-mon[93192]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:54.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:53 smithi016 ceph-mon[93192]: Reconfiguring osd.7 (monmap changed)... 2024-05-06T13:10:54.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:53 smithi016 ceph-mon[93192]: Reconfiguring daemon osd.7 on smithi186 2024-05-06T13:10:54.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:53 smithi016 ceph-mon[102669]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:54.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:53 smithi016 ceph-mon[102669]: Reconfiguring osd.7 (monmap changed)... 2024-05-06T13:10:54.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:53 smithi016 ceph-mon[102669]: Reconfiguring daemon osd.7 on smithi186 2024-05-06T13:10:54.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:53 smithi186 ceph-mon[83629]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:54.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:53 smithi186 ceph-mon[83629]: Reconfiguring osd.7 (monmap changed)... 2024-05-06T13:10:54.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:53 smithi186 ceph-mon[83629]: Reconfiguring daemon osd.7 on smithi186 2024-05-06T13:10:54.963 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:10:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:10:54] "GET /metrics HTTP/1.1" 200 38344 "" "Prometheus/2.33.4" 2024-05-06T13:10:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: Reconfiguring rgw.foo.smithi186.wuvklh (monmap changed)... 2024-05-06T13:10:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:55 smithi186 ceph-mon[83629]: Reconfiguring daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: Reconfiguring rgw.foo.smithi186.wuvklh (monmap changed)... 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:55.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[93192]: Reconfiguring daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: Reconfiguring rgw.foo.smithi186.wuvklh (monmap changed)... 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:55.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:55 smithi016 ceph-mon[102669]: Reconfiguring daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: Reconfiguring rgw.smpl.smithi186.dsrbux (monmap changed)... 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:57 smithi186 ceph-mon[83629]: Reconfiguring daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:10:57.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:57.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: Reconfiguring rgw.smpl.smithi186.dsrbux (monmap changed)... 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[93192]: Reconfiguring daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: Reconfiguring rgw.smpl.smithi186.dsrbux (monmap changed)... 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:57.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:10:57.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:10:57.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:57 smithi016 ceph-mon[102669]: Reconfiguring daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:10:58.884 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:10:59.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:10:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:10:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:10:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-05-06T13:10:59.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:10:59.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:10:59.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:10:59.576 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:10:59.576 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 9s ago 14m - - 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 10s ago 14m - - 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (4m) 9s ago 9m 23.7M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (4m) 10s ago 9m 51.8M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (3m) 9s ago 8m 52.6M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (3m) 10s ago 13m 509M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (2m) 9s ago 15m 450M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (110s) 9s ago 15m 48.6M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (45s) 10s ago 14m 32.0M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (64s) 9s ago 14m 39.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (4m) 9s ago 10m 18.8M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (4m) 10s ago 9m 18.2M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (13m) 9s ago 13m 53.4M 2481M 17.2.0 e1d6a67b021e 0f76c5751ae7 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (13m) 9s ago 13m 55.0M 2481M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (12m) 9s ago 12m 51.0M 2481M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:10:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (12m) 9s ago 12m 52.5M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (12m) 10s ago 12m 54.4M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (11m) 10s ago 11m 54.2M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (11m) 10s ago 11m 50.8M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (11m) 10s ago 11m 54.1M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (3m) 10s ago 10m 65.1M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (8m) 9s ago 8m 75.0M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (8m) 10s ago 8m 73.2M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (8m) 9s ago 8m 74.8M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:10:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (8m) 10s ago 8m 73.1M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:11:00.000 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:11:00.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:00.002 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:11:00.002 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-05-06T13:11:00.002 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 5 2024-05-06T13:11:00.002 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:11:00.002 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:11:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all mon 2024-05-06T13:11:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all crash 2024-05-06T13:11:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: Upgrade: osd.0 is safe to restart 2024-05-06T13:11:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all mon 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all crash 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: Upgrade: osd.0 is safe to restart 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:11:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:10:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all mon 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all crash 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: Upgrade: osd.0 is safe to restart 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:11:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:10:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "5/23 daemons upgraded", 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:11:00.359 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:11:00.778 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: from='client.64138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: from='client.64144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: Upgrade: Updating osd.0 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: Deploying daemon osd.0 on smithi016 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4235699215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/516532028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: from='client.64138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: from='client.64144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: Upgrade: Updating osd.0 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: Deploying daemon osd.0 on smithi016 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/4235699215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:01.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:00 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/516532028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: from='client.64138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: from='client.64144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: Upgrade: Updating osd.0 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: Deploying daemon osd.0 on smithi016 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/4235699215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:00 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/516532028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:11:01.961 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:01 smithi016 ceph-mon[93192]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:01.962 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:01 smithi016 ceph-mon[93192]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:01.962 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:01 smithi016 ceph-mon[102669]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:01.962 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:01 smithi016 ceph-mon[102669]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:01 smithi186 ceph-mon[83629]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:01 smithi186 ceph-mon[83629]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:02.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:02 smithi016 systemd[1]: Stopping Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:11:03.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:02 smithi016 ceph-mon[93192]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:03.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:02 smithi016 ceph-mon[102669]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:03.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[30681]: 2024-05-06T13:11:02.850+0000 7f4af59de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:11:03.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[30681]: 2024-05-06T13:11:02.850+0000 7f4af59de700 -1 osd.0 114 *** Got signal Terminated *** 2024-05-06T13:11:03.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:02 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[30681]: 2024-05-06T13:11:02.850+0000 7f4af59de700 -1 osd.0 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:11:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:02 smithi186 ceph-mon[83629]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:03 smithi016 ceph-mon[93192]: osd.0 marked itself down and dead 2024-05-06T13:11:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:04.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:03 smithi016 ceph-mon[102669]: osd.0 marked itself down and dead 2024-05-06T13:11:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:03 smithi186 ceph-mon[83629]: osd.0 marked itself down and dead 2024-05-06T13:11:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:04.584 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:04 smithi016 podman[110374]: 2024-05-06 13:11:04.297606521 +0000 UTC m=+1.559657589 container died 0f76c5751ae7aa77cdca25d8484aaee7503acbdb0e144fe9363fb7e67541b630 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, release=754, maintainer=Guillaume Abrioux , RELEASE=HEAD, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, architecture=x86_64) 2024-05-06T13:11:04.843 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:11:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:11:04] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.33.4" 2024-05-06T13:11:04.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:04 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:04.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:04 smithi186 ceph-mon[83629]: osdmap e115: 8 total, 7 up, 8 in 2024-05-06T13:11:04.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:04 smithi186 ceph-mon[83629]: pgmap v58: 161 pgs: 26 peering, 135 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s 2024-05-06T13:11:04.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:04 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:04.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:04 smithi016 ceph-mon[93192]: osdmap e115: 8 total, 7 up, 8 in 2024-05-06T13:11:04.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:04 smithi016 ceph-mon[93192]: pgmap v58: 161 pgs: 26 peering, 135 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s 2024-05-06T13:11:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:04 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:04 smithi016 ceph-mon[102669]: osdmap e115: 8 total, 7 up, 8 in 2024-05-06T13:11:04.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:04 smithi016 ceph-mon[102669]: pgmap v58: 161 pgs: 26 peering, 135 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s 2024-05-06T13:11:04.924 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:04 smithi016 podman[110374]: 2024-05-06 13:11:04.683770102 +0000 UTC m=+1.945821227 container cleanup 0f76c5751ae7aa77cdca25d8484aaee7503acbdb0e144fe9363fb7e67541b630 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, release=754, architecture=x86_64, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, version=8, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, ceph=True, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, maintainer=Guillaume Abrioux ) 2024-05-06T13:11:04.924 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:04 smithi016 bash[110374]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0 2024-05-06T13:11:05.252 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:04 smithi016 podman[110403]: 2024-05-06 13:11:04.926526259 +0000 UTC m=+0.619959473 container remove 0f76c5751ae7aa77cdca25d8484aaee7503acbdb0e144fe9363fb7e67541b630 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, release=754, GIT_BRANCH=HEAD, distribution-scope=public, version=8, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, ceph=True, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-05-06T13:11:05.505 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:05 smithi016 podman[110493]: 2024-05-06 13:11:05.155538929 +0000 UTC m=+0.019660945 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:05.505 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:05 smithi016 podman[110493]: 2024-05-06 13:11:05.26085721 +0000 UTC m=+0.124979227 container create 56c47e4751c860b3d3b6ba1b917fbbf6118a319d88fca0c7cbe2f1df7810e27d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-06T13:11:05.506 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:05 smithi016 podman[110493]: 2024-05-06 13:11:05.505846599 +0000 UTC m=+0.369968622 container init 56c47e4751c860b3d3b6ba1b917fbbf6118a319d88fca0c7cbe2f1df7810e27d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953) 2024-05-06T13:11:05.795 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:05 smithi016 podman[110493]: 2024-05-06 13:11:05.510138456 +0000 UTC m=+0.374260485 container start 56c47e4751c860b3d3b6ba1b917fbbf6118a319d88fca0c7cbe2f1df7810e27d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-06T13:11:05.796 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:05 smithi016 podman[110493]: 2024-05-06 13:11:05.572048739 +0000 UTC m=+0.436170765 container attach 56c47e4751c860b3d3b6ba1b917fbbf6118a319d88fca0c7cbe2f1df7810e27d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:06.005 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:05 smithi186 ceph-mon[83629]: Health check failed: Reduced data availability: 3 pgs inactive, 25 pgs peering (PG_AVAILABILITY) 2024-05-06T13:11:06.005 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:05 smithi186 ceph-mon[83629]: osdmap e116: 8 total, 7 up, 8 in 2024-05-06T13:11:06.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:05 smithi016 ceph-mon[93192]: Health check failed: Reduced data availability: 3 pgs inactive, 25 pgs peering (PG_AVAILABILITY) 2024-05-06T13:11:06.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:05 smithi016 ceph-mon[93192]: osdmap e116: 8 total, 7 up, 8 in 2024-05-06T13:11:06.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:05 smithi016 podman[110493]: 2024-05-06 13:11:05.820616391 +0000 UTC m=+0.684738410 container died 56c47e4751c860b3d3b6ba1b917fbbf6118a319d88fca0c7cbe2f1df7810e27d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-06T13:11:06.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:05 smithi016 ceph-mon[102669]: Health check failed: Reduced data availability: 3 pgs inactive, 25 pgs peering (PG_AVAILABILITY) 2024-05-06T13:11:06.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:05 smithi016 ceph-mon[102669]: osdmap e116: 8 total, 7 up, 8 in 2024-05-06T13:11:06.708 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 podman[110519]: 2024-05-06 13:11:06.458990524 +0000 UTC m=+0.631616284 container remove 56c47e4751c860b3d3b6ba1b917fbbf6118a319d88fca0c7cbe2f1df7810e27d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953) 2024-05-06T13:11:06.709 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-06T13:11:06.709 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 systemd[1]: Stopped Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:11:06.709 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0.service: Consumed 8.543s CPU time. 2024-05-06T13:11:06.709 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 systemd[1]: Starting Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:11:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:06 smithi186 ceph-mon[83629]: pgmap v60: 161 pgs: 15 stale+active+clean, 26 peering, 120 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:11:07.022 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:06 smithi016 ceph-mon[93192]: pgmap v60: 161 pgs: 15 stale+active+clean, 26 peering, 120 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:11:07.023 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:06 smithi016 ceph-mon[102669]: pgmap v60: 161 pgs: 15 stale+active+clean, 26 peering, 120 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:11:07.023 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 podman[110681]: 2024-05-06 13:11:06.92704663 +0000 UTC m=+0.110338389 container create 00f5a2bacf44814e0f26d4267589c886bca3888ac3e599a80c7d6ef446abe008 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-06T13:11:07.023 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:06 smithi016 podman[110681]: 2024-05-06 13:11:06.836984108 +0000 UTC m=+0.020275866 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:07.423 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 podman[110681]: 2024-05-06 13:11:07.137975229 +0000 UTC m=+0.321266987 container init 00f5a2bacf44814e0f26d4267589c886bca3888ac3e599a80c7d6ef446abe008 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_BRANCH=HEAD) 2024-05-06T13:11:07.423 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 podman[110681]: 2024-05-06 13:11:07.141289706 +0000 UTC m=+0.324581469 container start 00f5a2bacf44814e0f26d4267589c886bca3888ac3e599a80c7d6ef446abe008 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:11:07.423 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 podman[110681]: 2024-05-06 13:11:07.238110989 +0000 UTC m=+0.421402749 container attach 00f5a2bacf44814e0f26d4267589c886bca3888ac3e599a80c7d6ef446abe008 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-05-06T13:11:07.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:07.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:07.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 bash[110681]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[110731]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-06T13:11:07.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:07 smithi016 podman[110681]: 2024-05-06 13:11:07.677934816 +0000 UTC m=+0.861226579 container died 00f5a2bacf44814e0f26d4267589c886bca3888ac3e599a80c7d6ef446abe008 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:08.919 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:11:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:11:08.658Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:11:09.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:08 smithi016 ceph-mon[93192]: pgmap v61: 161 pgs: 15 stale+active+clean, 26 peering, 120 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-05-06T13:11:09.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:08 smithi016 ceph-mon[102669]: pgmap v61: 161 pgs: 15 stale+active+clean, 26 peering, 120 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-05-06T13:11:09.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:08 smithi016 podman[110935]: 2024-05-06 13:11:08.823679432 +0000 UTC m=+1.174074092 container remove 00f5a2bacf44814e0f26d4267589c886bca3888ac3e599a80c7d6ef446abe008 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, RELEASE=squid-70ce953, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-06T13:11:09.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 podman[111049]: 2024-05-06 13:11:08.953247446 +0000 UTC m=+0.019601731 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:09.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 podman[111049]: 2024-05-06 13:11:09.072097634 +0000 UTC m=+0.138451902 container create 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-06T13:11:09.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:08 smithi186 ceph-mon[83629]: pgmap v61: 161 pgs: 15 stale+active+clean, 26 peering, 120 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-05-06T13:11:09.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 podman[111049]: 2024-05-06 13:11:09.300044256 +0000 UTC m=+0.366398528 container init 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:09.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 podman[111049]: 2024-05-06 13:11:09.303488014 +0000 UTC m=+0.369842284 container start 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:11:09.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 ceph-osd[111080]: -- 172.21.15.16:0/4021761839 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55acbf13d680 con 0x55acbf107400 2024-05-06T13:11:09.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 bash[111049]: 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 2024-05-06T13:11:09.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 systemd[1]: Started Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:11:10.173 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:09 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:09.852+0000 7f0ec10927c0 -1 Falling back to public interface 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:10.774 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:10.774 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.774 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.775 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.775 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.775 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.775 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.775 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.775 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.776 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.777 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.778 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.779 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.780 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:10.781 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.782 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.782 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:10.782 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.782 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:10.782 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:11 smithi186 ceph-mon[83629]: pgmap v62: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:11 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:11 smithi186 ceph-mon[83629]: Upgrade: osd.0 is safe to restart 2024-05-06T13:11:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:11 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:11 smithi186 ceph-mon[83629]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 25 pgs peering) 2024-05-06T13:11:11.793 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[93192]: pgmap v62: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:11.793 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:11.793 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[93192]: Upgrade: osd.0 is safe to restart 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[93192]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 25 pgs peering) 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[102669]: pgmap v62: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[102669]: Upgrade: osd.0 is safe to restart 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:11.794 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:11 smithi016 ceph-mon[102669]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 25 pgs peering) 2024-05-06T13:11:12.621 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:12.556+0000 7f0ec10927c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-05-06T13:11:12.621 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:12 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:12.582+0000 7f0ec10927c0 -1 osd.0 114 log_to_monitors true 2024-05-06T13:11:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:13 smithi186 ceph-mon[83629]: pgmap v63: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 380 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:13 smithi186 ceph-mon[83629]: from='osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:13 smithi186 ceph-mon[83629]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:13.816 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:13 smithi016 ceph-mon[102669]: pgmap v63: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 380 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:13.816 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:13 smithi016 ceph-mon[102669]: from='osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:13.816 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:13 smithi016 ceph-mon[102669]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:13.817 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:13 smithi016 ceph-mon[93192]: pgmap v63: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 380 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:13.817 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:13 smithi016 ceph-mon[93192]: from='osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:13.817 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:13 smithi016 ceph-mon[93192]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:13.817 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:13.493+0000 7f0eb24e9700 -1 osd.0 114 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:11:14.734 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: osdmap e117: 8 total, 7 up, 8 in 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: from='osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: Upgrade: Updating osd.0 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[93192]: Deploying daemon osd.0 on smithi016 2024-05-06T13:11:14.899 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: osdmap e117: 8 total, 7 up, 8 in 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: from='osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: Upgrade: Updating osd.0 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:14 smithi016 ceph-mon[102669]: Deploying daemon osd.0 on smithi016 2024-05-06T13:11:14.900 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:11:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:11:14] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.33.4" 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: osdmap e117: 8 total, 7 up, 8 in 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: from='osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: Upgrade: Updating osd.0 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:14.901 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:14 smithi186 ceph-mon[83629]: Deploying daemon osd.0 on smithi016 2024-05-06T13:11:15.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:15 smithi186 ceph-mon[83629]: pgmap v65: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 565 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:15.723 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:15 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:15 smithi186 ceph-mon[83629]: osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380] boot 2024-05-06T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:15 smithi186 ceph-mon[83629]: osdmap e118: 8 total, 8 up, 8 in 2024-05-06T13:11:15.724 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[93192]: pgmap v65: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 565 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[93192]: osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380] boot 2024-05-06T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[93192]: osdmap e118: 8 total, 8 up, 8 in 2024-05-06T13:11:15.748 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:11:15.749 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[102669]: pgmap v65: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 565 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:15.749 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:11:15.749 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[102669]: osd.0 [v2:172.21.15.16:6800/3946271380,v1:172.21.15.16:6801/3946271380] boot 2024-05-06T13:11:15.749 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[102669]: osdmap e118: 8 total, 8 up, 8 in 2024-05-06T13:11:15.749 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:11:16.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:16 smithi186 ceph-mon[83629]: osdmap e119: 8 total, 8 up, 8 in 2024-05-06T13:11:16.865 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:16 smithi016 ceph-mon[93192]: osdmap e119: 8 total, 8 up, 8 in 2024-05-06T13:11:16.865 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:16 smithi016 ceph-mon[102669]: osdmap e119: 8 total, 8 up, 8 in 2024-05-06T13:11:17.738 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:17 smithi016 ceph-mon[93192]: pgmap v68: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:17.738 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:17 smithi016 ceph-mon[102669]: pgmap v68: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:17.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:17 smithi186 ceph-mon[83629]: pgmap v68: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:18 smithi186 ceph-mon[83629]: pgmap v69: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:19.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:11:18 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:11:18.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"smithi186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.16\", device_class=\"ssd\", hostname=\"smithi016\", instance=\"172.21.15.186:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.16\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-06T13:11:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[93192]: pgmap v69: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:19.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:18 smithi016 systemd[1]: Stopping Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:11:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[102669]: pgmap v69: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:19.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:19.256+0000 7f0eb76f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:11:19.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:19.256+0000 7f0eb76f8700 -1 osd.0 119 *** Got signal Terminated *** 2024-05-06T13:11:19.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[111064]: 2024-05-06T13:11:19.256+0000 7f0eb76f8700 -1 osd.0 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:11:20.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: osd.0 marked itself down and dead 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: osd.0 marked itself down and dead 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:11:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: osd.0 marked itself down and dead 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:11:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:20.923 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:20 smithi016 podman[112684]: 2024-05-06 13:11:20.585495077 +0000 UTC m=+1.443102429 container died 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=) 2024-05-06T13:11:21.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:21.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[93192]: osdmap e120: 8 total, 7 up, 8 in 2024-05-06T13:11:21.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:11:21.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded) 2024-05-06T13:11:21.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:21.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[102669]: osdmap e120: 8 total, 7 up, 8 in 2024-05-06T13:11:21.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:11:21.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:21 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded) 2024-05-06T13:11:21.424 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:20 smithi016 podman[112684]: 2024-05-06 13:11:20.998376329 +0000 UTC m=+1.855983681 container cleanup 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-06T13:11:21.424 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:20 smithi016 bash[112684]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0 2024-05-06T13:11:21.424 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:21 smithi016 podman[112736]: 2024-05-06 13:11:21.241467503 +0000 UTC m=+0.647931976 container remove 00e0330b1d82c6c30bb7e057231a0929283abd5c810478935a739014998a2550 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.license=GPLv2) 2024-05-06T13:11:21.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:21 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:21.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:21 smithi186 ceph-mon[83629]: osdmap e120: 8 total, 7 up, 8 in 2024-05-06T13:11:21.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:21 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:11:21.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:21 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded) 2024-05-06T13:11:21.844 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:21 smithi016 podman[112827]: 2024-05-06 13:11:21.464864225 +0000 UTC m=+0.018370712 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:21.845 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:21 smithi016 podman[112827]: 2024-05-06 13:11:21.584048656 +0000 UTC m=+0.137555127 container create b4526a61cc5524853194b907c34efe189dd7221b511d1499fc922c7b406fd65d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:11:21.845 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:21 smithi016 podman[112827]: 2024-05-06 13:11:21.845262148 +0000 UTC m=+0.398768626 container init b4526a61cc5524853194b907c34efe189dd7221b511d1499fc922c7b406fd65d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, RELEASE=squid-70ce953, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-06T13:11:22.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:22 smithi016 ceph-mon[93192]: osdmap e121: 8 total, 7 up, 8 in 2024-05-06T13:11:22.157 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:22 smithi016 ceph-mon[93192]: pgmap v73: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-05-06T13:11:22.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:22 smithi016 ceph-mon[102669]: osdmap e121: 8 total, 7 up, 8 in 2024-05-06T13:11:22.158 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:22 smithi016 ceph-mon[102669]: pgmap v73: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-05-06T13:11:22.158 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:21 smithi016 podman[112827]: 2024-05-06 13:11:21.849445822 +0000 UTC m=+0.402952298 container start b4526a61cc5524853194b907c34efe189dd7221b511d1499fc922c7b406fd65d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:22.158 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:21 smithi016 podman[112827]: 2024-05-06 13:11:21.903330877 +0000 UTC m=+0.456837355 container attach b4526a61cc5524853194b907c34efe189dd7221b511d1499fc922c7b406fd65d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.build-date=20240430) 2024-05-06T13:11:22.423 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:22 smithi016 podman[112827]: 2024-05-06 13:11:22.158922645 +0000 UTC m=+0.712429124 container died b4526a61cc5524853194b907c34efe189dd7221b511d1499fc922c7b406fd65d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-06T13:11:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:22 smithi186 ceph-mon[83629]: osdmap e121: 8 total, 7 up, 8 in 2024-05-06T13:11:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:22 smithi186 ceph-mon[83629]: pgmap v73: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-05-06T13:11:22.724 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:22 smithi016 podman[112853]: 2024-05-06 13:11:22.707226197 +0000 UTC m=+0.539742637 container remove b4526a61cc5524853194b907c34efe189dd7221b511d1499fc922c7b406fd65d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, ceph=True) 2024-05-06T13:11:22.724 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:22 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-06T13:11:22.724 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:22 smithi016 systemd[1]: Stopped Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:11:22.724 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:22 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0.service: Consumed 1.885s CPU time. 2024-05-06T13:11:23.173 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:22 smithi016 systemd[1]: Starting Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:11:23.485 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 podman[112958]: 2024-05-06 13:11:23.174980391 +0000 UTC m=+0.114348777 container create 029cda0381c218fa4dc51b824bbcb4fb8bf040ba73d88aac50cc50b0f805bbfd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-05-06T13:11:23.485 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 podman[112958]: 2024-05-06 13:11:23.078801381 +0000 UTC m=+0.018169779 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:23.485 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 podman[112958]: 2024-05-06 13:11:23.410934034 +0000 UTC m=+0.350302421 container init 029cda0381c218fa4dc51b824bbcb4fb8bf040ba73d88aac50cc50b0f805bbfd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-06T13:11:23.485 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 podman[112958]: 2024-05-06 13:11:23.41436436 +0000 UTC m=+0.353732746 container start 029cda0381c218fa4dc51b824bbcb4fb8bf040ba73d88aac50cc50b0f805bbfd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:11:23.485 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 podman[112958]: 2024-05-06 13:11:23.485888778 +0000 UTC m=+0.425257165 container attach 029cda0381c218fa4dc51b824bbcb4fb8bf040ba73d88aac50cc50b0f805bbfd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-06T13:11:24.173 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:24.173 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 bash[112958]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:24.174 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:11:24.175 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:11:24.175 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-06T13:11:24.175 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T13:11:24.175 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate[112973]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-06T13:11:24.175 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:23 smithi016 podman[112958]: 2024-05-06 13:11:23.89662748 +0000 UTC m=+0.835995866 container died 029cda0381c218fa4dc51b824bbcb4fb8bf040ba73d88aac50cc50b0f805bbfd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:11:24.497 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:24 smithi016 ceph-mon[93192]: pgmap v74: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 687 B/s rd, 0 op/s 2024-05-06T13:11:24.497 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:24 smithi016 ceph-mon[102669]: pgmap v74: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 687 B/s rd, 0 op/s 2024-05-06T13:11:24.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:24 smithi186 ceph-mon[83629]: pgmap v74: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 687 B/s rd, 0 op/s 2024-05-06T13:11:24.627 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:11:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:11:24] "GET /metrics HTTP/1.1" 200 38272 "" "Prometheus/2.33.4" 2024-05-06T13:11:24.756 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:24 smithi016 podman[113094]: 2024-05-06 13:11:24.498334002 +0000 UTC m=+0.594549817 container remove 029cda0381c218fa4dc51b824bbcb4fb8bf040ba73d88aac50cc50b0f805bbfd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-activate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-06T13:11:24.756 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:24 smithi016 podman[113158]: 2024-05-06 13:11:24.618179324 +0000 UTC m=+0.018239045 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:24.757 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:24 smithi016 podman[113158]: 2024-05-06 13:11:24.757372566 +0000 UTC m=+0.157432265 container create 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:25.026 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:24 smithi016 podman[113158]: 2024-05-06 13:11:24.968755415 +0000 UTC m=+0.368815123 container init 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-06T13:11:25.026 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:24 smithi016 podman[113158]: 2024-05-06 13:11:24.972260753 +0000 UTC m=+0.372320452 container start 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T13:11:25.026 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:24 smithi016 ceph-osd[113176]: -- 172.21.15.16:0/3082567647 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8dac1b680 con 0x55a8dabe5000 2024-05-06T13:11:25.309 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:25 smithi016 bash[113158]: 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa 2024-05-06T13:11:25.310 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:25 smithi016 systemd[1]: Started Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:11:25.673 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:25 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[113172]: 2024-05-06T13:11:25.512+0000 7f232a8aa7c0 -1 Falling back to public interface 2024-05-06T13:11:26.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: pgmap v75: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:26.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: pgmap v75: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.188 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.190 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.190 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.190 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: pgmap v75: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:26.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:26.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:26.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:26.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:26.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:27.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:11:27.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.306 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:27.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:27.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:27.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: pgmap v76: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: pgmap v76: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: pgmap v76: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:28.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:28.554 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:28 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[113172]: 2024-05-06T13:11:28.292+0000 7f232a8aa7c0 -1 osd.0 119 log_to_monitors true 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:29.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:29.923 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:11:29 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[113172]: 2024-05-06T13:11:29.563+0000 7f2317cf9700 -1 osd.0 119 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:11:30.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: pgmap v77: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: osdmap e122: 8 total, 7 up, 8 in 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.389 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: pgmap v77: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: osdmap e122: 8 total, 7 up, 8 in 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.393 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.394 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.396 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.397 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: pgmap v77: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: osdmap e122: 8 total, 7 up, 8 in 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048]' entity='osd.0' 2024-05-06T13:11:30.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:30.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:30.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:30.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:30.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:30.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.178 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048] boot 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: osdmap e123: 8 total, 8 up, 8 in 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048] boot 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: osdmap e123: 8 total, 8 up, 8 in 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: osd.0 [v2:172.21.15.16:6800/2168390048,v1:172.21.15.16:6801/2168390048] boot 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: osdmap e123: 8 total, 8 up, 8 in 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:31.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:31.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:31.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:31.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 12s ago 15m - - 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 2s ago 15m - - 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (5m) 12s ago 10m 23.7M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (4m) 2s ago 9m 52.2M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (3m) 12s ago 8m 52.7M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (4m) 2s ago 14m 514M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (2m) 12s ago 16m 450M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (2m) 12s ago 16m 50.9M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (78s) 2s ago 14m 41.9M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (96s) 12s ago 14m 42.0M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:11:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (5m) 12s ago 10m 19.9M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (4m) 2s ago 10m 20.7M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 starting - - - 2481M 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (13m) 12s ago 13m 56.5M 2481M 17.2.0 e1d6a67b021e 24670f647bf0 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (13m) 12s ago 13m 51.3M 2481M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (13m) 12s ago 13m 53.0M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (12m) 2s ago 12m 56.3M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (12m) 2s ago 12m 55.7M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (11m) 2s ago 11m 52.6M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (11m) 2s ago 11m 55.5M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (3m) 2s ago 10m 65.2M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (9m) 12s ago 9m 75.1M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (9m) 2s ago 9m 73.4M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (8m) 12s ago 8m 74.9M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:11:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (8m) 2s ago 8m 73.2M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:11:32.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.310 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: pgmap v80: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.311 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.312 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: osdmap e124: 8 total, 8 up, 8 in 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: pgmap v80: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:32.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.315 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: osdmap e124: 8 total, 8 up, 8 in 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='client.64192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='client.64192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.319 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:32.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 1 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 6 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:11:32.420 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:11:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: pgmap v80: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: osdmap e124: 8 total, 8 up, 8 in 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='client.64192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:32.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:32.802 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "5/23 daemons upgraded", 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:11:32.803 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:11:33.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/341131675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/341131675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:33.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 1.0 is active+undersized+degraded, acting [7,6] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.4 is active+undersized+degraded, acting [1,7] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.5 is active+undersized+degraded, acting [7,4] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.f is active+undersized+degraded, acting [4,7] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1f is active+undersized+degraded, acting [7,4] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.1 is active+undersized+degraded, acting [4,3] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.3 is active+undersized+degraded, acting [4,6] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.6 is active+undersized+degraded, acting [1,4] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.7 is active+undersized+degraded, acting [3,7] 2024-05-06T13:11:33.243 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.b is active+undersized+degraded, acting [3,4] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.f is active+undersized+degraded, acting [7,4] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.10 is active+undersized+degraded, acting [6,5] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.12 is active+undersized+degraded, acting [7,3] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.17 is active+undersized+degraded, acting [5,3] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.18 is active+undersized+degraded, acting [3,1] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.1b is active+undersized+degraded, acting [4,7] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.1f is active+undersized+degraded, acting [5,2] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 4.0 is active+undersized+degraded, acting [3,7] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 4.3 is active+undersized+degraded, acting [5,7] 2024-05-06T13:11:33.244 INFO:teuthology.orchestra.run.smithi016.stdout: pg 5.1d is active+undersized+degraded, acting [1,4] 2024-05-06T13:11:33.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/341131675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='client.64210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:34.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: pgmap v82: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1546695057' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='client.64210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:34.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: pgmap v82: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1546695057' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.329 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.334 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.334 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.334 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='client.64210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:11:34.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: pgmap v82: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 67/630 objects degraded (10.635%) 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1546695057' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:11:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:11:34] "GET /metrics HTTP/1.1" 200 38287 "" "Prometheus/2.33.4" 2024-05-06T13:11:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:35.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.375 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.376 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.379 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.380 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.381 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.382 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.385 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.386 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.387 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.388 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:36.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:36.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:36.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:36.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:36.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded) 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded) 2024-05-06T13:11:37.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:11:37.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/630 objects degraded (10.635%), 20 pgs degraded) 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:37.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 651 B/s rd, 0 op/s 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 651 B/s rd, 0 op/s 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 651 B/s rd, 0 op/s 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:38.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:38.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:38.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:38.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:38.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.410 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.410 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.411 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.412 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.413 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:40.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.415 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.416 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.417 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.417 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.417 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.417 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[93192]: Upgrade: osd.1 is safe to restart 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:11:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:11:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:40 smithi016 ceph-mon[102669]: Upgrade: osd.1 is safe to restart 2024-05-06T13:11:40.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:40.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:11:40.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:40 smithi186 ceph-mon[83629]: Upgrade: osd.1 is safe to restart 2024-05-06T13:11:41.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:41 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:11:41.300 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:41 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:11:41.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:41 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:11:42.238 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:42 smithi016 ceph-mon[93192]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:11:42.239 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:42 smithi016 ceph-mon[102669]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:11:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:42 smithi186 ceph-mon[83629]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: Upgrade: Updating osd.1 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: Deploying daemon osd.1 on smithi016 2024-05-06T13:11:44.036 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[93192]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 0 op/s 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: Upgrade: Updating osd.1 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: Deploying daemon osd.1 on smithi016 2024-05-06T13:11:44.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:43 smithi016 ceph-mon[102669]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 0 op/s 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: Upgrade: Updating osd.1 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: Deploying daemon osd.1 on smithi016 2024-05-06T13:11:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:43 smithi186 ceph-mon[83629]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 0 op/s 2024-05-06T13:11:44.886 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:11:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:11:44] "GET /metrics HTTP/1.1" 200 38287 "" "Prometheus/2.33.4" 2024-05-06T13:11:45.456 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:11:45.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:11:45.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:45.675 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:46.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:46 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:11:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:46 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:11:46.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:46 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:11:46.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:46 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:11:46.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:46 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:11:46.480 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:46 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:11:47.353 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:47 smithi016 ceph-mon[93192]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:11:47.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:47 smithi016 ceph-mon[102669]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:11:47.382 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:47 smithi186 ceph-mon[83629]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:11:48.846 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:48 smithi016 systemd[1]: Stopping Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:11:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[102669]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 558 B/s rd, 0 op/s 2024-05-06T13:11:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[102669]: osd.1 marked itself down and dead 2024-05-06T13:11:49.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:49.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[93192]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 558 B/s rd, 0 op/s 2024-05-06T13:11:49.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:48 smithi016 ceph-mon[93192]: osd.1 marked itself down and dead 2024-05-06T13:11:49.174 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[33571]: 2024-05-06T13:11:48.844+0000 7f5346d19700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:11:49.174 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[33571]: 2024-05-06T13:11:48.844+0000 7f5346d19700 -1 osd.1 124 *** Got signal Terminated *** 2024-05-06T13:11:49.174 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[33571]: 2024-05-06T13:11:48.844+0000 7f5346d19700 -1 osd.1 124 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:11:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:11:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:48 smithi186 ceph-mon[83629]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 558 B/s rd, 0 op/s 2024-05-06T13:11:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:48 smithi186 ceph-mon[83629]: osd.1 marked itself down and dead 2024-05-06T13:11:49.636 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:49 smithi016 podman[119967]: 2024-05-06 13:11:49.345240848 +0000 UTC m=+0.634821624 container died 24670f647bf089fe53f7b63b56beab4636b906c568871536805eb9d12791981a (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.openshift.expose-services=, io.buildah.version=1.19.8, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, version=8, RELEASE=HEAD, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870) 2024-05-06T13:11:49.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:49.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[93192]: osdmap e125: 8 total, 7 up, 8 in 2024-05-06T13:11:49.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:49.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:49 smithi016 podman[119967]: 2024-05-06 13:11:49.637041536 +0000 UTC m=+0.926622299 container cleanup 24670f647bf089fe53f7b63b56beab4636b906c568871536805eb9d12791981a (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, architecture=x86_64, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, version=8, vendor=Red Hat, Inc., GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, distribution-scope=public, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container) 2024-05-06T13:11:49.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:49 smithi016 bash[119967]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1 2024-05-06T13:11:49.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:49 smithi016 podman[119985]: 2024-05-06 13:11:49.821589932 +0000 UTC m=+0.479199702 container remove 24670f647bf089fe53f7b63b56beab4636b906c568871536805eb9d12791981a (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, version=8, release=754, ceph=True, RELEASE=HEAD, io.openshift.expose-services=, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, distribution-scope=public, vcs-type=git, GIT_BRANCH=HEAD) 2024-05-06T13:11:49.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:49.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[102669]: osdmap e125: 8 total, 7 up, 8 in 2024-05-06T13:11:49.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:49.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:49.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:49 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:11:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:49 smithi186 ceph-mon[83629]: osdmap e125: 8 total, 7 up, 8 in 2024-05-06T13:11:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:49 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:11:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:50.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:50.549 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:50 smithi016 podman[120078]: 2024-05-06 13:11:50.163107423 +0000 UTC m=+0.018650656 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:50.549 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:50 smithi016 podman[120078]: 2024-05-06 13:11:50.289206603 +0000 UTC m=+0.144749808 container create 046e5efa73a486f740af43396e62e37f79c9416f6de18108297823081e2f41db (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, ceph=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T13:11:50.549 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:50 smithi016 podman[120078]: 2024-05-06 13:11:50.474953921 +0000 UTC m=+0.330497131 container init 046e5efa73a486f740af43396e62e37f79c9416f6de18108297823081e2f41db (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240430, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-06T13:11:50.549 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:50 smithi016 podman[120078]: 2024-05-06 13:11:50.478316002 +0000 UTC m=+0.333859213 container start 046e5efa73a486f740af43396e62e37f79c9416f6de18108297823081e2f41db (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-06T13:11:50.549 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:50 smithi016 podman[120078]: 2024-05-06 13:11:50.549974391 +0000 UTC m=+0.405517607 container attach 046e5efa73a486f740af43396e62e37f79c9416f6de18108297823081e2f41db (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:50.892 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:50 smithi016 podman[120078]: 2024-05-06 13:11:50.782072733 +0000 UTC m=+0.637615946 container died 046e5efa73a486f740af43396e62e37f79c9416f6de18108297823081e2f41db (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953) 2024-05-06T13:11:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:50 smithi016 ceph-mon[93192]: osdmap e126: 8 total, 7 up, 8 in 2024-05-06T13:11:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:50 smithi016 ceph-mon[93192]: pgmap v94: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:11:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:50 smithi016 ceph-mon[102669]: osdmap e126: 8 total, 7 up, 8 in 2024-05-06T13:11:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:50 smithi016 ceph-mon[102669]: pgmap v94: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:11:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:50 smithi186 ceph-mon[83629]: osdmap e126: 8 total, 7 up, 8 in 2024-05-06T13:11:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:50 smithi186 ceph-mon[83629]: pgmap v94: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:11:51.605 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 podman[120104]: 2024-05-06 13:11:51.470665031 +0000 UTC m=+0.682968381 container remove 046e5efa73a486f740af43396e62e37f79c9416f6de18108297823081e2f41db (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-06T13:11:51.605 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-06T13:11:51.605 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 systemd[1]: Stopped Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:11:51.605 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1.service: Consumed 9.589s CPU time. 2024-05-06T13:11:51.894 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 systemd[1]: Starting Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:11:52.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:51 smithi016 ceph-mon[93192]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-06T13:11:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:51 smithi016 ceph-mon[102669]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-06T13:11:52.174 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 podman[120210]: 2024-05-06 13:11:51.840893361 +0000 UTC m=+0.018719496 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:52.174 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:51 smithi016 podman[120210]: 2024-05-06 13:11:51.955492363 +0000 UTC m=+0.133318482 container create c25719d5ee10ad3ce9db0516eb4cfacacde561290428a6156ed8aede1ef930ea (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, RELEASE=squid-70ce953, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-05-06T13:11:52.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:51 smithi186 ceph-mon[83629]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-06T13:11:52.652 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 podman[120210]: 2024-05-06 13:11:52.188658776 +0000 UTC m=+0.366484911 container init c25719d5ee10ad3ce9db0516eb4cfacacde561290428a6156ed8aede1ef930ea (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-06T13:11:52.652 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 podman[120210]: 2024-05-06 13:11:52.192298932 +0000 UTC m=+0.370125053 container start c25719d5ee10ad3ce9db0516eb4cfacacde561290428a6156ed8aede1ef930ea (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:11:52.652 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 podman[120210]: 2024-05-06 13:11:52.274592536 +0000 UTC m=+0.452418667 container attach c25719d5ee10ad3ce9db0516eb4cfacacde561290428a6156ed8aede1ef930ea (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux ) 2024-05-06T13:11:52.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:52 smithi016 ceph-mon[93192]: pgmap v95: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:11:52.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:52 smithi016 ceph-mon[102669]: pgmap v95: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 bash[120210]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:11:52.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-06T13:11:52.925 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:11:52.925 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[120225]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-06T13:11:52.925 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:52 smithi016 podman[120210]: 2024-05-06 13:11:52.677273461 +0000 UTC m=+0.855099584 container died c25719d5ee10ad3ce9db0516eb4cfacacde561290428a6156ed8aede1ef930ea (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:11:53.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:52 smithi186 ceph-mon[83629]: pgmap v95: 161 pgs: 7 peering, 20 stale+active+clean, 134 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:11:53.570 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 podman[120351]: 2024-05-06 13:11:53.32036481 +0000 UTC m=+0.637664313 container remove c25719d5ee10ad3ce9db0516eb4cfacacde561290428a6156ed8aede1ef930ea (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-06T13:11:53.571 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 podman[120415]: 2024-05-06 13:11:53.444669377 +0000 UTC m=+0.018610012 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:11:53.571 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 podman[120415]: 2024-05-06 13:11:53.571378145 +0000 UTC m=+0.145318754 container create b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:11:53.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 podman[120415]: 2024-05-06 13:11:53.765109199 +0000 UTC m=+0.339049807 container init b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-06T13:11:53.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 podman[120415]: 2024-05-06 13:11:53.768157135 +0000 UTC m=+0.342097748 container start b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-06T13:11:53.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 ceph-osd[120434]: -- 172.21.15.16:0/2233703593 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b4b5e1680 con 0x556b4b5aac00 2024-05-06T13:11:54.173 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 bash[120415]: b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 2024-05-06T13:11:54.173 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:53 smithi016 systemd[1]: Started Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:11:54.673 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:54 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:11:54.316+0000 7fa1c53b67c0 -1 Falling back to public interface 2024-05-06T13:11:54.883 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:11:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:11:54] "GET /metrics HTTP/1.1" 200 38423 "" "Prometheus/2.33.4" 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: pgmap v96: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:55.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: pgmap v96: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: pgmap v96: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:55.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:55.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 83/630 objects degraded (13.175%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 83/630 objects degraded (13.175%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 83/630 objects degraded (13.175%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:56.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.165 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:11:57.047+0000 7fa1c53b67c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-05-06T13:11:57.165 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:11:57.072+0000 7fa1c53b67c0 -1 osd.1 124 log_to_monitors true 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: pgmap v97: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: pgmap v97: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: pgmap v97: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:57.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.173 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:11:58 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:11:58.012+0000 7fa1b680d700 -1 osd.1 124 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:11:58.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:11:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: osdmap e127: 8 total, 7 up, 8 in 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: pgmap v99: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: osdmap e127: 8 total, 7 up, 8 in 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: pgmap v99: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: osdmap e127: 8 total, 7 up, 8 in 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: pgmap v99: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.298 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:11:59.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276] boot 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: osdmap e128: 8 total, 8 up, 8 in 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:11:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276] boot 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: osdmap e128: 8 total, 8 up, 8 in 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: osd.1 [v2:172.21.15.16:6808/3392609276,v1:172.21.15.16:6809/3392609276] boot 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: osdmap e128: 8 total, 8 up, 8 in 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.295 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.296 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:00.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:11:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: osdmap e129: 8 total, 8 up, 8 in 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: pgmap v102: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: osdmap e129: 8 total, 8 up, 8 in 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: pgmap v102: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:01.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: osdmap e129: 8 total, 8 up, 8 in 2024-05-06T13:12:01.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: pgmap v102: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:01.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:01.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:01.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:01.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.274 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.275 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.276 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:02.277 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.004 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.004 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.263 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: pgmap v103: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: pgmap v103: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.268 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:03.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: pgmap v103: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.278 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:03.634 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.264 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.265 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.266 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.267 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.268 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.269 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='client.64228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.270 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.271 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='client.64228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.272 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.275 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='client.64228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.276 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:04.277 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:04.390 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 19s ago 15m - - 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 14s ago 15m - - 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (5m) 19s ago 10m 23.7M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (5m) 14s ago 10m 52.2M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (4m) 19s ago 9m 54.8M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (4m) 14s ago 15m 517M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (3m) 19s ago 16m 450M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (2m) 19s ago 16m 52.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (110s) 14s ago 15m 38.7M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (2m) 19s ago 15m 43.3M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (5m) 19s ago 11m 18.6M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (5m) 14s ago 11m 18.3M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (39s) 19s ago 14m 51.9M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 starting - - - 2481M 2024-05-06T13:12:04.391 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (13m) 19s ago 13m 52.6M 2481M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (13m) 19s ago 13m 54.7M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (13m) 14s ago 13m 56.1M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (12m) 14s ago 12m 56.6M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (12m) 14s ago 12m 53.2M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (12m) 14s ago 12m 55.2M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (4m) 14s ago 11m 65.2M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (9m) 19s ago 9m 75.2M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (9m) 14s ago 9m 73.5M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (9m) 19s ago 9m 75.0M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:12:04.392 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (9m) 14s ago 9m 73.3M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:12:04.834 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:12:04.834 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:12:04.834 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:12:04.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:04.834 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:12:04.834 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 7 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:12:04.835 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:12:04.902 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:12:04] "GET /metrics HTTP/1.1" 200 38300 "" "Prometheus/2.33.4" 2024-05-06T13:12:05.121 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.122 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:05.123 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.124 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.125 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.127 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/308710210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.129 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.130 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/308710210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.131 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:05.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.165 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.166 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.167 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.168 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.168 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:05.168 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/308710210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:05.169 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:05.170 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:05.170 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:05.170 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:05.198 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "6/23 daemons upgraded", 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:12:05.199 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:12:05.621 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='client.44355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: Upgrade: osd.1 is safe to restart 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded) 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:12:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:06 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3033952830' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.354 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='client.44355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: Upgrade: osd.1 is safe to restart 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded) 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3033952830' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='client.44355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:06.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:12:06.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-06T13:12:06.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: Upgrade: osd.1 is safe to restart 2024-05-06T13:12:06.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 77/630 objects degraded (12.222%), 20 pgs degraded) 2024-05-06T13:12:06.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:12:06.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:06 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3033952830' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:12:07.116 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:07 smithi016 ceph-mon[93192]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:12:07.116 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:07 smithi016 ceph-mon[102669]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:12:07.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:07 smithi186 ceph-mon[83629]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[93192]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 549 B/s rd, 0 op/s 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[102669]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 549 B/s rd, 0 op/s 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.511 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:09 smithi186 ceph-mon[83629]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 549 B/s rd, 0 op/s 2024-05-06T13:12:09.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:09.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.596 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:10.596 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.596 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.596 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.596 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: Upgrade: Updating osd.1 2024-05-06T13:12:10.596 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: Deploying daemon osd.1 on smithi016 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: Upgrade: Updating osd.1 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:12:10.597 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:10.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: Deploying daemon osd.1 on smithi016 2024-05-06T13:12:10.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: Upgrade: Updating osd.1 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-06T13:12:10.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: Deploying daemon osd.1 on smithi016 2024-05-06T13:12:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:10.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:11.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:11 smithi186 ceph-mon[83629]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2024-05-06T13:12:11.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:11 smithi016 ceph-mon[93192]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2024-05-06T13:12:11.839 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:11 smithi016 ceph-mon[102669]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2024-05-06T13:12:13.325 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:13 smithi016 systemd[1]: Stopping Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:12:13.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:13 smithi016 ceph-mon[93192]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:12:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:13.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:13 smithi016 ceph-mon[93192]: osd.1 marked itself down and dead 2024-05-06T13:12:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:13 smithi016 ceph-mon[102669]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:12:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:13.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:13 smithi016 ceph-mon[102669]: osd.1 marked itself down and dead 2024-05-06T13:12:13.675 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:12:13.364+0000 7fa1bba1c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:12:13.675 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:12:13.364+0000 7fa1bba1c700 -1 osd.1 129 *** Got signal Terminated *** 2024-05-06T13:12:13.675 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:13 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[120430]: 2024-05-06T13:12:13.364+0000 7fa1bba1c700 -1 osd.1 129 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:12:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:13 smithi186 ceph-mon[83629]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:12:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:13.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:13 smithi186 ceph-mon[83629]: osd.1 marked itself down and dead 2024-05-06T13:12:14.587 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:14 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:12:14.587 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:14 smithi016 ceph-mon[93192]: osdmap e130: 8 total, 7 up, 8 in 2024-05-06T13:12:14.588 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:14 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:12:14.588 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:14 smithi016 ceph-mon[102669]: osdmap e130: 8 total, 7 up, 8 in 2024-05-06T13:12:14.588 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:14 smithi016 podman[126031]: 2024-05-06 13:12:14.337152403 +0000 UTC m=+1.155980658 container died b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-05-06T13:12:14.588 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:14 smithi016 podman[126031]: 2024-05-06 13:12:14.572695155 +0000 UTC m=+1.391523401 container cleanup b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.build-date=20240430) 2024-05-06T13:12:14.588 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:14 smithi016 bash[126031]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1 2024-05-06T13:12:14.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:12:14] "GET /metrics HTTP/1.1" 200 38300 "" "Prometheus/2.33.4" 2024-05-06T13:12:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:14 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:12:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:14 smithi186 ceph-mon[83629]: osdmap e130: 8 total, 7 up, 8 in 2024-05-06T13:12:15.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:14 smithi016 podman[126048]: 2024-05-06 13:12:14.740481211 +0000 UTC m=+0.404900190 container remove b5b80731c95bac83cfe9c9de0faca9b45b268fdd506ca755aa1ec8763e8b6c10 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:12:15.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:15 smithi016 podman[126139]: 2024-05-06 13:12:15.149624482 +0000 UTC m=+0.104669766 container create 9e5f726e483829339ed5fa94095402089bd881aeac5e2bb6785fcfd61d3e021a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-05-06T13:12:15.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:15 smithi016 podman[126139]: 2024-05-06 13:12:15.063607878 +0000 UTC m=+0.018653181 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:12:15.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:15 smithi016 podman[126139]: 2024-05-06 13:12:15.360984852 +0000 UTC m=+0.316030145 container init 9e5f726e483829339ed5fa94095402089bd881aeac5e2bb6785fcfd61d3e021a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_BRANCH=HEAD) 2024-05-06T13:12:15.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:15 smithi016 podman[126139]: 2024-05-06 13:12:15.364657701 +0000 UTC m=+0.319702986 container start 9e5f726e483829339ed5fa94095402089bd881aeac5e2bb6785fcfd61d3e021a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:12:15.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:15 smithi186 ceph-mon[83629]: pgmap v110: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:12:15.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:15 smithi186 ceph-mon[83629]: osdmap e131: 8 total, 7 up, 8 in 2024-05-06T13:12:15.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:15 smithi016 ceph-mon[93192]: pgmap v110: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:12:15.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:15 smithi016 ceph-mon[93192]: osdmap e131: 8 total, 7 up, 8 in 2024-05-06T13:12:15.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:15 smithi016 ceph-mon[102669]: pgmap v110: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:12:15.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:15 smithi016 ceph-mon[102669]: osdmap e131: 8 total, 7 up, 8 in 2024-05-06T13:12:15.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:15 smithi016 podman[126139]: 2024-05-06 13:12:15.445605392 +0000 UTC m=+0.400650689 container attach 9e5f726e483829339ed5fa94095402089bd881aeac5e2bb6785fcfd61d3e021a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:12:15.924 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:15 smithi016 podman[126139]: 2024-05-06 13:12:15.673150133 +0000 UTC m=+0.628195424 container died 9e5f726e483829339ed5fa94095402089bd881aeac5e2bb6785fcfd61d3e021a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-06T13:12:16.519 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 podman[126166]: 2024-05-06 13:12:16.264833782 +0000 UTC m=+0.585959009 container remove 9e5f726e483829339ed5fa94095402089bd881aeac5e2bb6785fcfd61d3e021a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953) 2024-05-06T13:12:16.519 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-06T13:12:16.519 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 systemd[1]: Stopped Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:12:16.519 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1.service: Consumed 1.882s CPU time. 2024-05-06T13:12:16.840 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 systemd[1]: Starting Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:12:16.840 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 podman[126268]: 2024-05-06 13:12:16.732450463 +0000 UTC m=+0.108845835 container create d70cd291d65cba8c965cc71e2dab7194ebbc75c671e796d7dc0b299bc1029bbd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-06T13:12:16.840 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:16 smithi016 podman[126268]: 2024-05-06 13:12:16.642013839 +0000 UTC m=+0.018409231 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:12:17.101 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 podman[126268]: 2024-05-06 13:12:17.018620939 +0000 UTC m=+0.395016314 container init d70cd291d65cba8c965cc71e2dab7194ebbc75c671e796d7dc0b299bc1029bbd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-06T13:12:17.101 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 podman[126268]: 2024-05-06 13:12:17.022081153 +0000 UTC m=+0.398476526 container start d70cd291d65cba8c965cc71e2dab7194ebbc75c671e796d7dc0b299bc1029bbd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-05-06T13:12:17.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 podman[126268]: 2024-05-06 13:12:17.101853813 +0000 UTC m=+0.478249192 container attach d70cd291d65cba8c965cc71e2dab7194ebbc75c671e796d7dc0b299bc1029bbd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-06T13:12:17.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:17 smithi186 ceph-mon[83629]: pgmap v112: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:12:17.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:17 smithi016 ceph-mon[93192]: pgmap v112: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:12:17.830 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:17 smithi016 ceph-mon[102669]: pgmap v112: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 bash[126268]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-06T13:12:17.831 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T13:12:17.832 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate[126284]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-06T13:12:17.832 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:17 smithi016 podman[126268]: 2024-05-06 13:12:17.505427356 +0000 UTC m=+0.881822740 container died d70cd291d65cba8c965cc71e2dab7194ebbc75c671e796d7dc0b299bc1029bbd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-06T13:12:18.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 podman[126410]: 2024-05-06 13:12:18.139624394 +0000 UTC m=+0.628328395 container remove d70cd291d65cba8c965cc71e2dab7194ebbc75c671e796d7dc0b299bc1029bbd (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:12:18.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 podman[126476]: 2024-05-06 13:12:18.262489409 +0000 UTC m=+0.018888979 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:12:18.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 podman[126476]: 2024-05-06 13:12:18.373998963 +0000 UTC m=+0.130398561 container create f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:12:18.883 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 podman[126476]: 2024-05-06 13:12:18.601514531 +0000 UTC m=+0.357914106 container init f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430) 2024-05-06T13:12:18.883 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 podman[126476]: 2024-05-06 13:12:18.60487827 +0000 UTC m=+0.361277827 container start f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS) 2024-05-06T13:12:18.883 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 ceph-osd[126496]: -- 172.21.15.16:0/3094314707 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648ea46b680 con 0x5648ea435000 2024-05-06T13:12:18.883 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 bash[126476]: f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 2024-05-06T13:12:18.883 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:18 smithi016 systemd[1]: Started Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: pgmap v113: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:19.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: pgmap v113: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:19.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: pgmap v113: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:19.423 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[126492]: 2024-05-06T13:12:19.146+0000 7f5e0a4b47c0 -1 Falling back to public interface 2024-05-06T13:12:19.886 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:20.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:20.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: pgmap v114: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 83/630 objects degraded (13.175%) 2024-05-06T13:12:21.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.187 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: pgmap v114: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 83/630 objects degraded (13.175%) 2024-05-06T13:12:21.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.189 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.192 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.192 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.192 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.192 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.192 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.193 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.193 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.193 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.193 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: pgmap v114: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 83/630 objects degraded (13.175%) 2024-05-06T13:12:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:21.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:21.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:21.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.047 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[126492]: 2024-05-06T13:12:21.917+0000 7f5e0a4b47c0 -1 osd.1 129 log_to_monitors true 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.048 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 83/630 objects degraded (13.175%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.049 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.050 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 83/630 objects degraded (13.175%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.052 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.053 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.054 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 83/630 objects degraded (13.175%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.173 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:12:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[126492]: 2024-05-06T13:12:22.915+0000 7f5dfb90b700 -1 osd.1 129 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:12:23.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:12:23.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: pgmap v115: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 611 B/s rd, 0 op/s; 83/630 objects degraded (13.175%) 2024-05-06T13:12:23.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: pgmap v115: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 611 B/s rd, 0 op/s; 83/630 objects degraded (13.175%) 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: pgmap v115: 161 pgs: 21 active+undersized+degraded, 42 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 611 B/s rd, 0 op/s; 83/630 objects degraded (13.175%) 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.921 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.921 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: osdmap e132: 8 total, 7 up, 8 in 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.922 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: osdmap e132: 8 total, 7 up, 8 in 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:23.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-06T13:12:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: osdmap e132: 8 total, 7 up, 8 in 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:24.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:24.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:24.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:24.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:24.919 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:12:24] "GET /metrics HTTP/1.1" 200 38501 "" "Prometheus/2.33.4" 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609] boot 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: osdmap e133: 8 total, 8 up, 8 in 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.121 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.122 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.123 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: pgmap v118: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609] boot 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: osdmap e133: 8 total, 8 up, 8 in 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.124 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.125 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.126 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[93192]: osdmap e134: 8 total, 8 up, 8 in 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: pgmap v118: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:25.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.129 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.130 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:24 smithi016 ceph-mon[102669]: osdmap e134: 8 total, 8 up, 8 in 2024-05-06T13:12:25.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: osd.1 [v2:172.21.15.16:6808/2731161609,v1:172.21.15.16:6809/2731161609] boot 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: osdmap e133: 8 total, 8 up, 8 in 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: pgmap v118: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:25.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:24 smithi186 ceph-mon[83629]: osdmap e134: 8 total, 8 up, 8 in 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: pgmap v120: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 41 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: pgmap v120: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 41 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:26.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:26.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.183 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: pgmap v120: 161 pgs: 6 peering, 20 active+undersized+degraded, 37 active+undersized, 98 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 41 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:27.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:27.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:27.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:27.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:27.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:27.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:28.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: pgmap v121: 161 pgs: 6 peering, 13 active+undersized+degraded, 23 active+undersized, 119 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s; 47/630 objects degraded (7.460%); 0 B/s, 1 objects/s recovering 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: pgmap v121: 161 pgs: 6 peering, 13 active+undersized+degraded, 23 active+undersized, 119 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s; 47/630 objects degraded (7.460%); 0 B/s, 1 objects/s recovering 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: pgmap v121: 161 pgs: 6 peering, 13 active+undersized+degraded, 23 active+undersized, 119 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s; 47/630 objects degraded (7.460%); 0 B/s, 1 objects/s recovering 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:29.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:29.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:29.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:29.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:29.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:29.958 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:12:29.687+0000 7f9a35e30700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-05-06T13:12:30.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 47/630 objects degraded (7.460%), 13 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:30.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:29 smithi186 ceph-mon[83629]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.299 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 47/630 objects degraded (7.460%), 13 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.301 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 47/630 objects degraded (7.460%), 13 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[102669]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:30.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:30.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:30.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:29 smithi016 ceph-mon[93192]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-05-06T13:12:31.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[93192]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 0 B/s wr, 194 op/s; 0 B/s, 4 objects/s recovering 2024-05-06T13:12:31.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.332 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:31 smithi016 ceph-mon[102669]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 0 B/s wr, 194 op/s; 0 B/s, 4 objects/s recovering 2024-05-06T13:12:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:31.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:31 smithi186 ceph-mon[83629]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 0 B/s wr, 194 op/s; 0 B/s, 4 objects/s recovering 2024-05-06T13:12:32.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:32 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/630 objects degraded (7.460%), 13 pgs degraded) 2024-05-06T13:12:32.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:32 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:12:32.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:32 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/630 objects degraded (7.460%), 13 pgs degraded) 2024-05-06T13:12:32.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:32 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:12:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:32 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/630 objects degraded (7.460%), 13 pgs degraded) 2024-05-06T13:12:32.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:32 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:12:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:33 smithi186 ceph-mon[83629]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 0 B/s wr, 147 op/s; 0 B/s, 4 objects/s recovering 2024-05-06T13:12:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:33.821 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[93192]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 0 B/s wr, 147 op/s; 0 B/s, 4 objects/s recovering 2024-05-06T13:12:33.821 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[102669]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 0 B/s wr, 147 op/s; 0 B/s, 4 objects/s recovering 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:33.822 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:12:34] "GET /metrics HTTP/1.1" 200 38505 "" "Prometheus/2.33.4" 2024-05-06T13:12:35.998 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[93192]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s; 0 B/s, 3 objects/s recovering 2024-05-06T13:12:35.998 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:35.998 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:35.998 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:35.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[102669]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s; 0 B/s, 3 objects/s recovering 2024-05-06T13:12:35.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:35.999 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:35.999 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:35.999 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:12:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:35 smithi186 ceph-mon[83629]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s; 0 B/s, 3 objects/s recovering 2024-05-06T13:12:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:36.680 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:12:36.680 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 1s ago 16m - - 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 6s ago 16m - - 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (6m) 1s ago 11m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (5m) 6s ago 10m 52.4M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (4m) 1s ago 9m 58.0M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (5m) 6s ago 15m 519M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (3m) 1s ago 17m 451M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (3m) 1s ago 17m 58.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (2m) 6s ago 15m 42.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (2m) 1s ago 16m 47.2M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (6m) 1s ago 11m 18.3M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (6m) 6s ago 11m 18.1M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (72s) 1s ago 15m 55.0M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (18s) 1s ago 14m 42.4M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (14m) 1s ago 14m 53.9M 2481M 17.2.0 e1d6a67b021e 35b2ce165be8 2024-05-06T13:12:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (14m) 1s ago 14m 57.6M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (13m) 6s ago 13m 60.2M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (13m) 6s ago 13m 59.6M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (12m) 6s ago 12m 55.4M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (12m) 6s ago 12m 58.3M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (5m) 6s ago 11m 68.0M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (10m) 1s ago 10m 75.8M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (10m) 6s ago 10m 73.7M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (9m) 1s ago 9m 75.3M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:12:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (9m) 6s ago 9m 73.5M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:12:37.090 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:12:37.090 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-05-06T13:12:37.091 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 7 2024-05-06T13:12:37.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:12:37.092 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:12:37.439 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:12:37.439 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:12:37.439 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:12:37.439 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:12:37.439 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:12:37.439 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:12:37.440 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:12:37.440 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:12:37.440 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "7/23 daemons upgraded", 2024-05-06T13:12:37.440 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:12:37.440 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:12:37.440 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:12:37.850 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:12:38.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:37 smithi186 ceph-mon[83629]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:37 smithi186 ceph-mon[83629]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 104 op/s; 0 B/s, 2 objects/s recovering 2024-05-06T13:12:38.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:37 smithi186 ceph-mon[83629]: from='client.44379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:37 smithi186 ceph-mon[83629]: from='client.64282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:37 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3457895701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:38.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[102669]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[102669]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 104 op/s; 0 B/s, 2 objects/s recovering 2024-05-06T13:12:38.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[102669]: from='client.44379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[102669]: from='client.64282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3457895701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[93192]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[93192]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 104 op/s; 0 B/s, 2 objects/s recovering 2024-05-06T13:12:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[93192]: from='client.44379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[93192]: from='client.64282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:37 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3457895701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:39.002 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:38 smithi016 ceph-mon[93192]: from='client.44397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:39.003 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:38 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/510832211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:12:39.003 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:39.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:38 smithi016 ceph-mon[102669]: from='client.44397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:39.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:38 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/510832211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:12:39.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:38 smithi186 ceph-mon[83629]: from='client.44397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:12:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:38 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/510832211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:12:39.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:40.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:39 smithi186 ceph-mon[83629]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s; 0 B/s, 2 objects/s recovering 2024-05-06T13:12:40.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:39 smithi016 ceph-mon[93192]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s; 0 B/s, 2 objects/s recovering 2024-05-06T13:12:40.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:39 smithi016 ceph-mon[102669]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s; 0 B/s, 2 objects/s recovering 2024-05-06T13:12:41.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:41.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:41.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:42.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:41 smithi186 ceph-mon[83629]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 88 op/s; 0 B/s, 1 objects/s recovering 2024-05-06T13:12:42.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:41 smithi016 ceph-mon[93192]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 88 op/s; 0 B/s, 1 objects/s recovering 2024-05-06T13:12:42.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:41 smithi016 ceph-mon[102669]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 88 op/s; 0 B/s, 1 objects/s recovering 2024-05-06T13:12:44.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:43 smithi186 ceph-mon[83629]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-06T13:12:44.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:43 smithi016 ceph-mon[93192]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-06T13:12:44.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:43 smithi016 ceph-mon[102669]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-06T13:12:44.916 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:12:44] "GET /metrics HTTP/1.1" 200 38505 "" "Prometheus/2.33.4" 2024-05-06T13:12:44.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:45.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:45.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:45 smithi186 ceph-mon[83629]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-06T13:12:45.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:45 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:45.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:45 smithi186 ceph-mon[83629]: Upgrade: osd.2 is safe to restart 2024-05-06T13:12:45.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:45 smithi016 ceph-mon[93192]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-06T13:12:45.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:45 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:45.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:45 smithi016 ceph-mon[93192]: Upgrade: osd.2 is safe to restart 2024-05-06T13:12:45.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:45 smithi016 ceph-mon[102669]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-06T13:12:45.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:45 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-06T13:12:45.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:45 smithi016 ceph-mon[102669]: Upgrade: osd.2 is safe to restart 2024-05-06T13:12:47.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[93192]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-06T13:12:47.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[93192]: Upgrade: Updating osd.2 2024-05-06T13:12:47.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[93192]: Deploying daemon osd.2 on smithi016 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[102669]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[102669]: Upgrade: Updating osd.2 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:47.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:47 smithi016 ceph-mon[102669]: Deploying daemon osd.2 on smithi016 2024-05-06T13:12:47.721 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:47 smithi186 ceph-mon[83629]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-06T13:12:47.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:47 smithi186 ceph-mon[83629]: Upgrade: Updating osd.2 2024-05-06T13:12:47.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:47.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-06T13:12:47.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:47.722 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:47 smithi186 ceph-mon[83629]: Deploying daemon osd.2 on smithi016 2024-05-06T13:12:48.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:48.809 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:48.809 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:12:49.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:49 smithi186 ceph-mon[83629]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-06T13:12:49.768 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:49 smithi016 ceph-mon[93192]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-06T13:12:49.768 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:49 smithi016 ceph-mon[102669]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-06T13:12:50.166 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:49 smithi016 systemd[1]: Stopping Ceph osd.2 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:12:50.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:50 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[36507]: 2024-05-06T13:12:50.165+0000 7fb43f802700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:12:50.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:50 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[36507]: 2024-05-06T13:12:50.165+0000 7fb43f802700 -1 osd.2 134 *** Got signal Terminated *** 2024-05-06T13:12:50.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:50 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[36507]: 2024-05-06T13:12:50.165+0000 7fb43f802700 -1 osd.2 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:12:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: osd.2 marked itself down and dead 2024-05-06T13:12:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: osd.2 marked itself down and dead 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: osd.2 marked itself down and dead 2024-05-06T13:12:50.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:50.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:51.226 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:50 smithi016 podman[132082]: 2024-05-06 13:12:50.953844816 +0000 UTC m=+0.904853030 container died 35b2ce165be80ae022e0812176c8284e72269cc68630f9737347ec9580680e05 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, RELEASE=HEAD, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, name=centos-stream, distribution-scope=public, version=8, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-06T13:12:51.497 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:51 smithi016 podman[132082]: 2024-05-06 13:12:51.391525846 +0000 UTC m=+1.342534057 container cleanup 35b2ce165be80ae022e0812176c8284e72269cc68630f9737347ec9580680e05 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , io.openshift.expose-services=, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, distribution-scope=public, version=8, architecture=x86_64, vcs-type=git, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, RELEASE=HEAD, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, ceph=True, CEPH_POINT_RELEASE=-17.2.0) 2024-05-06T13:12:51.497 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:51 smithi016 bash[132082]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2 2024-05-06T13:12:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:51 smithi186 ceph-mon[83629]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-05-06T13:12:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:51 smithi186 ceph-mon[83629]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 0 B/s wr, 143 op/s 2024-05-06T13:12:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:51 smithi186 ceph-mon[83629]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 0 B/s wr, 180 op/s 2024-05-06T13:12:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:51 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:12:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:51 smithi186 ceph-mon[83629]: osdmap e135: 8 total, 7 up, 8 in 2024-05-06T13:12:51.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:51 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:12:51.923 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:51 smithi016 podman[132125]: 2024-05-06 13:12:51.618148993 +0000 UTC m=+0.658668063 container remove 35b2ce165be80ae022e0812176c8284e72269cc68630f9737347ec9580680e05 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, name=centos-stream, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, RELEASE=HEAD, vendor=Red Hat, Inc., io.openshift.expose-services=, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754) 2024-05-06T13:12:51.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[93192]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-05-06T13:12:51.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[93192]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 0 B/s wr, 143 op/s 2024-05-06T13:12:51.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[93192]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 0 B/s wr, 180 op/s 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[93192]: osdmap e135: 8 total, 7 up, 8 in 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[102669]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[102669]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 0 B/s wr, 143 op/s 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[102669]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 0 B/s wr, 180 op/s 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[102669]: osdmap e135: 8 total, 7 up, 8 in 2024-05-06T13:12:51.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:51 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:12:52.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:52 smithi016 podman[132218]: 2024-05-06 13:12:51.976687898 +0000 UTC m=+0.018626407 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:12:52.424 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:52 smithi016 podman[132218]: 2024-05-06 13:12:52.127439832 +0000 UTC m=+0.169378340 container create ded2d7977ccaf8a93bac8c02e4418092fca25681f0c5555bcc20fad3fa98b75a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-06T13:12:52.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:52 smithi186 ceph-mon[83629]: osdmap e136: 8 total, 7 up, 8 in 2024-05-06T13:12:52.834 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:52 smithi016 ceph-mon[93192]: osdmap e136: 8 total, 7 up, 8 in 2024-05-06T13:12:52.834 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:52 smithi016 ceph-mon[102669]: osdmap e136: 8 total, 7 up, 8 in 2024-05-06T13:12:52.835 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:52 smithi016 podman[132218]: 2024-05-06 13:12:52.52214436 +0000 UTC m=+0.564082883 container init ded2d7977ccaf8a93bac8c02e4418092fca25681f0c5555bcc20fad3fa98b75a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T13:12:52.835 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:52 smithi016 podman[132218]: 2024-05-06 13:12:52.525623047 +0000 UTC m=+0.567561557 container start ded2d7977ccaf8a93bac8c02e4418092fca25681f0c5555bcc20fad3fa98b75a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-06T13:12:52.835 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:52 smithi016 podman[132218]: 2024-05-06 13:12:52.605409588 +0000 UTC m=+0.647348105 container attach ded2d7977ccaf8a93bac8c02e4418092fca25681f0c5555bcc20fad3fa98b75a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-06T13:12:53.083 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:52 smithi016 podman[132218]: 2024-05-06 13:12:52.835897427 +0000 UTC m=+0.877835928 container died ded2d7977ccaf8a93bac8c02e4418092fca25681f0c5555bcc20fad3fa98b75a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-06T13:12:53.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:53 smithi016 ceph-mon[93192]: pgmap v137: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:12:53.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:53 smithi016 ceph-mon[102669]: pgmap v137: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:12:53.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:53 smithi186 ceph-mon[83629]: pgmap v137: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:12:54.061 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:53 smithi016 podman[132262]: 2024-05-06 13:12:53.805834944 +0000 UTC m=+0.964557786 container remove ded2d7977ccaf8a93bac8c02e4418092fca25681f0c5555bcc20fad3fa98b75a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-06T13:12:54.061 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:53 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.2.service: Deactivated successfully. 2024-05-06T13:12:54.061 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:53 smithi016 systemd[1]: Stopped Ceph osd.2 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:12:54.061 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:53 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.2.service: Consumed 8.369s CPU time. 2024-05-06T13:12:54.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:54 smithi016 systemd[1]: Starting Ceph osd.2 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:12:54.842 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:54 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 55/630 objects degraded (8.730%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:54.843 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:54 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 55/630 objects degraded (8.730%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:54.843 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:54 smithi016 podman[132383]: 2024-05-06 13:12:54.618862797 +0000 UTC m=+0.019201264 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:12:54.843 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:54 smithi016 podman[132383]: 2024-05-06 13:12:54.718380154 +0000 UTC m=+0.118718648 container create 38f0a35363e2539c67832c67ad1055e906bd3b727cacf38101399d0ddd0ab3d9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-06T13:12:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:12:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:12:54] "GET /metrics HTTP/1.1" 200 38500 "" "Prometheus/2.33.4" 2024-05-06T13:12:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:54 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 55/630 objects degraded (8.730%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:12:55.173 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:54 smithi016 podman[132383]: 2024-05-06 13:12:54.938126597 +0000 UTC m=+0.338465055 container init 38f0a35363e2539c67832c67ad1055e906bd3b727cacf38101399d0ddd0ab3d9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:12:55.173 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:54 smithi016 podman[132383]: 2024-05-06 13:12:54.941538266 +0000 UTC m=+0.341876737 container start 38f0a35363e2539c67832c67ad1055e906bd3b727cacf38101399d0ddd0ab3d9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-06T13:12:55.174 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 podman[132383]: 2024-05-06 13:12:55.02125637 +0000 UTC m=+0.421594836 container attach 38f0a35363e2539c67832c67ad1055e906bd3b727cacf38101399d0ddd0ab3d9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_BRANCH=HEAD) 2024-05-06T13:12:55.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:55 smithi016 ceph-mon[93192]: pgmap v138: 161 pgs: 14 active+undersized+degraded, 2 stale+active+clean, 25 active+undersized, 120 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 55/630 objects degraded (8.730%) 2024-05-06T13:12:55.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:55 smithi016 ceph-mon[102669]: pgmap v138: 161 pgs: 14 active+undersized+degraded, 2 stale+active+clean, 25 active+undersized, 120 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 55/630 objects degraded (8.730%) 2024-05-06T13:12:55.674 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T13:12:55.674 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T13:12:55.674 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 bash[132383]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-06T13:12:55.675 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T13:12:55.676 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T13:12:55.676 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-06T13:12:55.676 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T13:12:55.676 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate[132398]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-06T13:12:55.676 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:55 smithi016 podman[132383]: 2024-05-06 13:12:55.430170957 +0000 UTC m=+0.830509413 container died 38f0a35363e2539c67832c67ad1055e906bd3b727cacf38101399d0ddd0ab3d9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-06T13:12:56.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:55 smithi186 ceph-mon[83629]: pgmap v138: 161 pgs: 14 active+undersized+degraded, 2 stale+active+clean, 25 active+undersized, 120 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 55/630 objects degraded (8.730%) 2024-05-06T13:12:56.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 podman[132535]: 2024-05-06 13:12:56.134011479 +0000 UTC m=+0.698225834 container remove 38f0a35363e2539c67832c67ad1055e906bd3b727cacf38101399d0ddd0ab3d9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:12:56.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 podman[132598]: 2024-05-06 13:12:56.351646447 +0000 UTC m=+0.110964333 container create 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-05-06T13:12:56.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 podman[132598]: 2024-05-06 13:12:56.260156496 +0000 UTC m=+0.019474397 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:12:56.892 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 podman[132598]: 2024-05-06 13:12:56.563313536 +0000 UTC m=+0.322631429 container init 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:12:56.892 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 podman[132598]: 2024-05-06 13:12:56.566512226 +0000 UTC m=+0.325830113 container start 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:12:56.892 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 ceph-osd[132617]: -- 172.21.15.16:0/1361796888 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558821895680 con 0x55882185ec00 2024-05-06T13:12:56.893 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 bash[132598]: 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 2024-05-06T13:12:56.893 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:56 smithi016 systemd[1]: Started Ceph osd.2 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:12:57.166 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:12:57.117+0000 7efe0cd407c0 -1 Falling back to public interface 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: pgmap v139: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: pgmap v140: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: pgmap v139: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:12:58.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.079 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: pgmap v140: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.080 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: pgmap v139: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.081 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: pgmap v140: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.082 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.083 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:58.086 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.023 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.023 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.024 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:12:59.026 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.029 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:12:59.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:12:59.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:12:59.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: pgmap v141: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 617 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:12:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.051 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:12:59.851+0000 7efe0cd407c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-05-06T13:13:00.051 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:12:59 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:12:59.876+0000 7efe0cd407c0 -1 osd.2 134 log_to_monitors true 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.052 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: pgmap v141: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 617 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: pgmap v141: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 617 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.055 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.056 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.058 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.060 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.061 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:12:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.923 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:13:00 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:13:00.832+0000 7efdfe197700 -1 osd.2 134 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:00.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:13:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.966 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.966 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.967 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: pgmap v142: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: osdmap e137: 8 total, 7 up, 8 in 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.968 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: pgmap v142: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: osdmap e137: 8 total, 7 up, 8 in 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.971 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.972 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.973 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.974 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:01.975 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: pgmap v142: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: osdmap e137: 8 total, 7 up, 8 in 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:02.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.996 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.997 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891] boot 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: osdmap e138: 8 total, 8 up, 8 in 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:02.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:02.999 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891] boot 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: osdmap e138: 8 total, 8 up, 8 in 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.000 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.001 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.002 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.003 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.004 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.005 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.006 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.007 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.008 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.009 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: osd.2 [v2:172.21.15.16:6816/162799891,v1:172.21.15.16:6817/162799891] boot 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: osdmap e138: 8 total, 8 up, 8 in 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: pgmap v145: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: osdmap e139: 8 total, 8 up, 8 in 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: pgmap v145: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: osdmap e139: 8 total, 8 up, 8 in 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.933 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.934 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.935 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:03.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:03.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:03.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:03.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:03.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: pgmap v145: 161 pgs: 15 active+undersized+degraded, 31 active+undersized, 115 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 780 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: osdmap e139: 8 total, 8 up, 8 in 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.876 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.877 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.879 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.880 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 60/630 objects degraded (9.524%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.881 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.882 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.883 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 60/630 objects degraded (9.524%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.884 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:04.885 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:13:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:13:04] "GET /metrics HTTP/1.1" 200 38363 "" "Prometheus/2.33.4" 2024-05-06T13:13:05.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 60/630 objects degraded (9.524%), 15 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:05.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: pgmap v147: 161 pgs: 12 active+undersized, 149 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.148 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.149 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: pgmap v147: 161 pgs: 12 active+undersized, 149 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.150 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.152 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.153 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.155 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.191 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: pgmap v147: 161 pgs: 12 active+undersized, 149 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.192 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.193 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.194 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.195 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 60/630 objects degraded (9.524%), 15 pgs degraded) 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 60/630 objects degraded (9.524%), 15 pgs degraded) 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:06.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.932 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.932 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.933 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.934 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.935 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.936 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.936 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.937 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.938 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:06.939 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:06.940 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 60/630 objects degraded (9.524%), 15 pgs degraded) 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:07.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:07.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:07.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:07.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:07.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:13:08.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.233 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:08.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:08.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:09.016 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:13:09.016 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 0s ago 16m - - 2024-05-06T13:13:09.016 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 18s ago 16m - - 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (6m) 0s ago 11m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (6m) 18s ago 11m 52.4M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (5m) 0s ago 10m 58.0M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (5m) 18s ago 16m 521M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (4m) 0s ago 17m 451M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (4m) 0s ago 17m 59.9M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (2m) 18s ago 16m 43.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (3m) 0s ago 16m 51.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (6m) 0s ago 12m 20.5M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (6m) 18s ago 12m 20.8M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (104s) 0s ago 15m 56.2M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (50s) 0s ago 15m 44.5M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (12s) 0s ago 15m 12.3M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (14m) 0s ago 14m 59.2M 2481M 17.2.0 e1d6a67b021e 96f7441a4cce 2024-05-06T13:13:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (14m) 18s ago 14m 61.7M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (13m) 18s ago 13m 60.5M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (13m) 18s ago 13m 56.9M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (13m) 18s ago 13m 59.6M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (5m) 18s ago 12m 68.2M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (10m) 0s ago 10m 75.9M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (10m) 18s ago 10m 73.7M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (10m) 0s ago 10m 75.6M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:13:09.018 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (10m) 18s ago 10m 73.6M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:13:09.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:09.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:09.471 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:13:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:13:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:13:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:13:09.472 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:13:09.837 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:13:09.837 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "8/23 daemons upgraded", 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:13:09.838 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: Upgrade: osd.3 is safe to restart 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='client.44421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 643 B/s rd, 0 op/s 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.839 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1660016757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: Upgrade: osd.3 is safe to restart 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='client.44421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 643 B/s rd, 0 op/s 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.840 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:09.841 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:09 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1660016757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:10.252 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: Upgrade: osd.3 is safe to restart 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='client.44421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 643 B/s rd, 0 op/s 2024-05-06T13:13:10.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:10.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:10.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:10.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:09 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1660016757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='client.64324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1176436950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:13:11.132 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='client.64324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1176436950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:13:11.133 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='client.64324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1176436950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:13:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:12.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[93192]: from='client.44439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:12.084 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[93192]: Upgrade: Updating osd.3 2024-05-06T13:13:12.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[93192]: Deploying daemon osd.3 on smithi016 2024-05-06T13:13:12.085 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[93192]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:13:12.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[102669]: from='client.44439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:12.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[102669]: Upgrade: Updating osd.3 2024-05-06T13:13:12.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[102669]: Deploying daemon osd.3 on smithi016 2024-05-06T13:13:12.085 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:11 smithi016 ceph-mon[102669]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:13:12.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:11 smithi186 ceph-mon[83629]: from='client.44439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:12.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:11 smithi186 ceph-mon[83629]: Upgrade: Updating osd.3 2024-05-06T13:13:12.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:11 smithi186 ceph-mon[83629]: Deploying daemon osd.3 on smithi016 2024-05-06T13:13:12.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:11 smithi186 ceph-mon[83629]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:13:13.992 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:13 smithi016 ceph-mon[93192]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:13:13.993 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:13.993 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:13 smithi016 ceph-mon[102669]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:13:13.993 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:14.066 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:13 smithi186 ceph-mon[83629]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:13:14.067 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:15.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:13:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:13:14] "GET /metrics HTTP/1.1" 200 38363 "" "Prometheus/2.33.4" 2024-05-06T13:13:15.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:15 smithi016 systemd[1]: Stopping Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:13:15.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[39486]: 2024-05-06T13:13:15.375+0000 7fa193c51700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:13:15.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[39486]: 2024-05-06T13:13:15.375+0000 7fa193c51700 -1 osd.3 139 *** Got signal Terminated *** 2024-05-06T13:13:15.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[39486]: 2024-05-06T13:13:15.375+0000 7fa193c51700 -1 osd.3 139 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:13:16.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:15 smithi016 ceph-mon[93192]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:13:16.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:15 smithi016 ceph-mon[93192]: osd.3 marked itself down and dead 2024-05-06T13:13:16.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:15 smithi016 ceph-mon[102669]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:13:16.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:15 smithi016 ceph-mon[102669]: osd.3 marked itself down and dead 2024-05-06T13:13:16.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:15 smithi186 ceph-mon[83629]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:13:16.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:15 smithi186 ceph-mon[83629]: osd.3 marked itself down and dead 2024-05-06T13:13:16.494 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:16 smithi016 podman[138271]: 2024-05-06 13:13:16.225239735 +0000 UTC m=+0.946071482 container died 96f7441a4ccec3abb8d6ac2f317feccd59189c575b07bde81ef16cae6ece169c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, vcs-type=git, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, name=centos-stream, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-05-06T13:13:16.786 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:16 smithi016 podman[138271]: 2024-05-06 13:13:16.667703567 +0000 UTC m=+1.388535315 container cleanup 96f7441a4ccec3abb8d6ac2f317feccd59189c575b07bde81ef16cae6ece169c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., version=8, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, release=754, GIT_CLEAN=True, vcs-type=git, GIT_BRANCH=HEAD, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, build-date=2022-05-03T08:36:31.336870) 2024-05-06T13:13:16.786 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:16 smithi016 bash[138271]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3 2024-05-06T13:13:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:16 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:13:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:16 smithi016 ceph-mon[93192]: osdmap e140: 8 total, 7 up, 8 in 2024-05-06T13:13:17.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:16 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:13:17.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:16 smithi016 ceph-mon[102669]: osdmap e140: 8 total, 7 up, 8 in 2024-05-06T13:13:17.174 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:16 smithi016 podman[138291]: 2024-05-06 13:13:16.911235431 +0000 UTC m=+0.687435538 container remove 96f7441a4ccec3abb8d6ac2f317feccd59189c575b07bde81ef16cae6ece169c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, architecture=x86_64, distribution-scope=public, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., version=8, name=centos-stream, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , vcs-type=git, GIT_CLEAN=True, io.openshift.expose-services=, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-05-06T13:13:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:16 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:13:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:16 smithi186 ceph-mon[83629]: osdmap e140: 8 total, 7 up, 8 in 2024-05-06T13:13:17.639 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:17 smithi016 podman[138385]: 2024-05-06 13:13:17.249233431 +0000 UTC m=+0.018290770 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:13:17.639 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:17 smithi016 podman[138385]: 2024-05-06 13:13:17.36221035 +0000 UTC m=+0.131267668 container create cd4b3d179301ee69d7e0e8000fe15b63a13842ad36113d568a656ae0ba08a55c (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-06T13:13:17.639 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:17 smithi016 podman[138385]: 2024-05-06 13:13:17.556814541 +0000 UTC m=+0.325871860 container init cd4b3d179301ee69d7e0e8000fe15b63a13842ad36113d568a656ae0ba08a55c (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-70ce953) 2024-05-06T13:13:17.639 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:17 smithi016 podman[138385]: 2024-05-06 13:13:17.560310548 +0000 UTC m=+0.329367874 container start cd4b3d179301ee69d7e0e8000fe15b63a13842ad36113d568a656ae0ba08a55c (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-06T13:13:17.639 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:17 smithi016 podman[138385]: 2024-05-06 13:13:17.639637219 +0000 UTC m=+0.408694555 container attach cd4b3d179301ee69d7e0e8000fe15b63a13842ad36113d568a656ae0ba08a55c (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-06T13:13:17.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:17 smithi016 ceph-mon[93192]: pgmap v154: 161 pgs: 6 peering, 26 stale+active+clean, 129 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:13:17.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:17 smithi016 ceph-mon[93192]: osdmap e141: 8 total, 7 up, 8 in 2024-05-06T13:13:17.924 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:17 smithi016 podman[138385]: 2024-05-06 13:13:17.868469332 +0000 UTC m=+0.637526653 container died cd4b3d179301ee69d7e0e8000fe15b63a13842ad36113d568a656ae0ba08a55c (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-06T13:13:17.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:17 smithi016 ceph-mon[102669]: pgmap v154: 161 pgs: 6 peering, 26 stale+active+clean, 129 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:13:17.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:17 smithi016 ceph-mon[102669]: osdmap e141: 8 total, 7 up, 8 in 2024-05-06T13:13:18.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:17 smithi186 ceph-mon[83629]: pgmap v154: 161 pgs: 6 peering, 26 stale+active+clean, 129 active+clean; 585 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:13:18.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:17 smithi186 ceph-mon[83629]: osdmap e141: 8 total, 7 up, 8 in 2024-05-06T13:13:18.769 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:18 smithi016 podman[138411]: 2024-05-06 13:13:18.519203128 +0000 UTC m=+0.645293962 container remove cd4b3d179301ee69d7e0e8000fe15b63a13842ad36113d568a656ae0ba08a55c (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-06T13:13:18.769 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:18 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-06T13:13:18.769 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:18 smithi016 systemd[1]: Stopped Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:13:18.769 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:18 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3.service: Consumed 11.115s CPU time. 2024-05-06T13:13:18.769 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:18 smithi016 systemd[1]: Starting Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:13:19.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:19.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:19.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:18 smithi016 ceph-mon[93192]: pgmap v156: 161 pgs: 5 active+undersized+degraded, 6 peering, 20 stale+active+clean, 9 active+undersized, 121 active+clean; 585 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 17/630 objects degraded (2.698%) 2024-05-06T13:13:19.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:19.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:19.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:18 smithi016 ceph-mon[102669]: pgmap v156: 161 pgs: 5 active+undersized+degraded, 6 peering, 20 stale+active+clean, 9 active+undersized, 121 active+clean; 585 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 17/630 objects degraded (2.698%) 2024-05-06T13:13:19.038 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:18 smithi016 podman[138512]: 2024-05-06 13:13:18.894649064 +0000 UTC m=+0.019876995 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:13:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:18 smithi186 ceph-mon[83629]: pgmap v156: 161 pgs: 5 active+undersized+degraded, 6 peering, 20 stale+active+clean, 9 active+undersized, 121 active+clean; 585 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 17/630 objects degraded (2.698%) 2024-05-06T13:13:19.331 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 podman[138512]: 2024-05-06 13:13:19.037204653 +0000 UTC m=+0.162432555 container create 4f671afcd06b2898b745e963043679aa7e2fae1f6915051a4e41cd5581a439e4 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953) 2024-05-06T13:13:19.331 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 podman[138512]: 2024-05-06 13:13:19.248319874 +0000 UTC m=+0.373547776 container init 4f671afcd06b2898b745e963043679aa7e2fae1f6915051a4e41cd5581a439e4 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, ceph=True) 2024-05-06T13:13:19.331 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 podman[138512]: 2024-05-06 13:13:19.251717781 +0000 UTC m=+0.376945686 container start 4f671afcd06b2898b745e963043679aa7e2fae1f6915051a4e41cd5581a439e4 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:13:19.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 podman[138512]: 2024-05-06 13:13:19.33157527 +0000 UTC m=+0.456803180 container attach 4f671afcd06b2898b745e963043679aa7e2fae1f6915051a4e41cd5581a439e4 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-05-06T13:13:20.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:19 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 17/630 objects degraded (2.698%), 5 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:20.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:20.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:19 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 17/630 objects degraded (2.698%), 5 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:20.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:19 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-05-06T13:13:20.027 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 bash[138512]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[138527]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-06T13:13:20.028 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:19 smithi016 podman[138512]: 2024-05-06 13:13:19.732960127 +0000 UTC m=+0.858188032 container died 4f671afcd06b2898b745e963043679aa7e2fae1f6915051a4e41cd5581a439e4 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-06T13:13:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:19 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 17/630 objects degraded (2.698%), 5 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:19 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:20.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 podman[138649]: 2024-05-06 13:13:20.386415112 +0000 UTC m=+0.647946817 container remove 4f671afcd06b2898b745e963043679aa7e2fae1f6915051a4e41cd5581a439e4 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-70ce953, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:13:20.674 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 podman[138715]: 2024-05-06 13:13:20.515138859 +0000 UTC m=+0.018981391 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:13:20.674 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 podman[138715]: 2024-05-06 13:13:20.620589694 +0000 UTC m=+0.124432227 container create 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-06T13:13:20.997 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:20 smithi016 ceph-mon[93192]: pgmap v157: 161 pgs: 23 active+undersized+degraded, 6 peering, 37 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:20.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:20 smithi016 ceph-mon[102669]: pgmap v157: 161 pgs: 23 active+undersized+degraded, 6 peering, 37 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:20.998 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 podman[138715]: 2024-05-06 13:13:20.88867791 +0000 UTC m=+0.392520444 container init 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-06T13:13:20.998 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 podman[138715]: 2024-05-06 13:13:20.892972825 +0000 UTC m=+0.396815364 container start 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:13:20.998 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 ceph-osd[138733]: -- 172.21.15.16:0/2818875349 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561173403680 con 0x5611733cd000 2024-05-06T13:13:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:20 smithi186 ceph-mon[83629]: pgmap v157: 161 pgs: 23 active+undersized+degraded, 6 peering, 37 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:21.343 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:20 smithi016 bash[138715]: 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff 2024-05-06T13:13:21.343 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:21 smithi016 systemd[1]: Started Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:13:21.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:21 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:21.435+0000 7fc2df8427c0 -1 Falling back to public interface 2024-05-06T13:13:22.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.357 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.358 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.363 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.364 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:22.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.053 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.054 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: pgmap v158: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: pgmap v158: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: pgmap v158: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:23.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.423 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:24.166+0000 7fc2df8427c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-05-06T13:13:24.423 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:24.207+0000 7fc2df8427c0 -1 osd.3 139 log_to_monitors true 2024-05-06T13:13:24.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:24.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:13:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:13:24] "GET /metrics HTTP/1.1" 200 38512 "" "Prometheus/2.33.4" 2024-05-06T13:13:25.299 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:25 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:25.213+0000 7fc2d0c99700 -1 osd.3 139 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:25.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.302 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.303 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.304 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.305 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.306 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: pgmap v159: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.307 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.308 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.309 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: pgmap v159: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.310 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.311 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.311 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.311 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.311 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.311 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.324 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.325 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: pgmap v159: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.328 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:25.329 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: osdmap e142: 8 total, 7 up, 8 in 2024-05-06T13:13:26.484 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.485 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.486 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.488 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.488 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: osdmap e142: 8 total, 7 up, 8 in 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.676 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: osdmap e142: 8 total, 7 up, 8 in 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.677 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.678 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.678 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.678 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.678 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.678 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.678 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.679 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.680 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.681 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.682 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.683 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.683 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.683 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.683 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.683 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.683 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.684 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:26.685 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049] boot 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: osdmap e143: 8 total, 8 up, 8 in 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.314 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.315 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.316 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: pgmap v162: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.317 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.318 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049] boot 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: osdmap e143: 8 total, 8 up, 8 in 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:13:27.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: osd.3 [v2:172.21.15.16:6824/4240640049,v1:172.21.15.16:6825/4240640049] boot 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: osdmap e143: 8 total, 8 up, 8 in 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: pgmap v162: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: pgmap v162: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:27.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:27.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:27.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:27.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:27.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: osdmap e144: 8 total, 8 up, 8 in 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: osdmap e144: 8 total, 8 up, 8 in 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.421 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.422 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: osdmap e144: 8 total, 8 up, 8 in 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:28.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.321 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.322 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.323 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: pgmap v164: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 68/630 objects degraded (10.794%) 2024-05-06T13:13:29.324 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.326 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.327 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.328 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: pgmap v164: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 68/630 objects degraded (10.794%) 2024-05-06T13:13:29.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.331 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.332 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.333 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.334 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.334 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.335 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.337 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.338 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: pgmap v164: 161 pgs: 20 active+undersized+degraded, 38 active+undersized, 103 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 68/630 objects degraded (10.794%) 2024-05-06T13:13:29.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:29.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:30.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:30.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:30.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:30.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:30.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: Upgrade: osd.3 is safe to restart 2024-05-06T13:13:30.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 68/630 objects degraded (10.794%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: Upgrade: osd.3 is safe to restart 2024-05-06T13:13:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:30 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 68/630 objects degraded (10.794%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:30.476 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: Upgrade: osd.3 is safe to restart 2024-05-06T13:13:30.477 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:30 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 68/630 objects degraded (10.794%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:31.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:31 smithi186 ceph-mon[83629]: pgmap v165: 161 pgs: 5 active+undersized, 156 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:31.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[93192]: pgmap v165: 161 pgs: 5 active+undersized, 156 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:31.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:31.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:31 smithi016 ceph-mon[102669]: pgmap v165: 161 pgs: 5 active+undersized, 156 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:32.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:32 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/630 objects degraded (10.794%), 20 pgs degraded) 2024-05-06T13:13:32.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:32 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:13:32.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:32 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/630 objects degraded (10.794%), 20 pgs degraded) 2024-05-06T13:13:32.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:32 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:13:32.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:32 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/630 objects degraded (10.794%), 20 pgs degraded) 2024-05-06T13:13:32.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:32 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:13:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:33 smithi186 ceph-mon[83629]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:33.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:33.827 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:33 smithi016 ceph-mon[93192]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:33.827 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:33.827 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:33.827 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:33 smithi016 ceph-mon[102669]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:33.828 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:33.828 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:34.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[93192]: Upgrade: Updating osd.3 2024-05-06T13:13:34.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:13:34.597 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:34.598 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[93192]: Deploying daemon osd.3 on smithi016 2024-05-06T13:13:34.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[102669]: Upgrade: Updating osd.3 2024-05-06T13:13:34.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:13:34.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:34.598 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:34 smithi016 ceph-mon[102669]: Deploying daemon osd.3 on smithi016 2024-05-06T13:13:34.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:13:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:13:34] "GET /metrics HTTP/1.1" 200 38520 "" "Prometheus/2.33.4" 2024-05-06T13:13:34.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:34 smithi186 ceph-mon[83629]: Upgrade: Updating osd.3 2024-05-06T13:13:34.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-06T13:13:34.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:34.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:34 smithi186 ceph-mon[83629]: Deploying daemon osd.3 on smithi016 2024-05-06T13:13:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:35 smithi186 ceph-mon[83629]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.769 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[93192]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:35.769 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.769 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.769 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.770 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[102669]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:35.770 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.770 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:35.770 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[93192]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.062 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.063 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:36 smithi016 ceph-mon[102669]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-05-06T13:13:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:36 smithi186 ceph-mon[83629]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-05-06T13:13:38.674 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:38 smithi016 systemd[1]: Stopping Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:13:38.999 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:38.680+0000 7fc2d5ea8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:13:38.999 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:38.680+0000 7fc2d5ea8700 -1 osd.3 144 *** Got signal Terminated *** 2024-05-06T13:13:39.000 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:38 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[138729]: 2024-05-06T13:13:38.680+0000 7fc2d5ea8700 -1 osd.3 144 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:13:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:39 smithi186 ceph-mon[83629]: osd.3 marked itself down and dead 2024-05-06T13:13:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:39 smithi186 ceph-mon[83629]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-05-06T13:13:39.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:39.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:39 smithi016 ceph-mon[102669]: osd.3 marked itself down and dead 2024-05-06T13:13:39.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:39 smithi016 ceph-mon[102669]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-05-06T13:13:39.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:39 smithi016 ceph-mon[93192]: osd.3 marked itself down and dead 2024-05-06T13:13:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:39 smithi016 ceph-mon[93192]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 88 B/s rd, 0 op/s 2024-05-06T13:13:39.748 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:39 smithi016 podman[143107]: 2024-05-06 13:13:39.45764782 +0000 UTC m=+0.890820683 container died 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-06T13:13:40.000 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:39 smithi016 podman[143107]: 2024-05-06 13:13:39.847340867 +0000 UTC m=+1.280513729 container cleanup 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:13:40.000 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:39 smithi016 bash[143107]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3 2024-05-06T13:13:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:40 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:13:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:40 smithi186 ceph-mon[83629]: osdmap e145: 8 total, 7 up, 8 in 2024-05-06T13:13:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:40.423 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:40 smithi016 podman[143125]: 2024-05-06 13:13:40.115316355 +0000 UTC m=+0.648733448 container remove 8dd2cf254139776156cc05277c423bb0a3fd64ea5e8a0bc843bbad0a3e3a3aff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953) 2024-05-06T13:13:40.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:40 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:13:40.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:40 smithi016 ceph-mon[93192]: osdmap e145: 8 total, 7 up, 8 in 2024-05-06T13:13:40.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:40 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:13:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:40 smithi016 ceph-mon[102669]: osdmap e145: 8 total, 7 up, 8 in 2024-05-06T13:13:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:40.639 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:13:40.747 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:40 smithi016 podman[143220]: 2024-05-06 13:13:40.399915555 +0000 UTC m=+0.020248244 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:13:40.747 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:40 smithi016 podman[143220]: 2024-05-06 13:13:40.533352585 +0000 UTC m=+0.153685238 container create 8f404a27e37cc2f05fb309b15106ca047157d34dc227f9e33ce726dd8a055c6f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-06T13:13:40.747 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:40 smithi016 podman[143220]: 2024-05-06 13:13:40.744296405 +0000 UTC m=+0.364629062 container init 8f404a27e37cc2f05fb309b15106ca047157d34dc227f9e33ce726dd8a055c6f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:13:40.747 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:40 smithi016 podman[143220]: 2024-05-06 13:13:40.747683897 +0000 UTC m=+0.368016560 container start 8f404a27e37cc2f05fb309b15106ca047157d34dc227f9e33ce726dd8a055c6f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-05-06T13:13:41.008 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:40 smithi016 podman[143220]: 2024-05-06 13:13:40.878015451 +0000 UTC m=+0.498348120 container attach 8f404a27e37cc2f05fb309b15106ca047157d34dc227f9e33ce726dd8a055c6f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T13:13:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:41 smithi186 ceph-mon[83629]: osdmap e146: 8 total, 7 up, 8 in 2024-05-06T13:13:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:41 smithi186 ceph-mon[83629]: from='client.64354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:41 smithi186 ceph-mon[83629]: pgmap v172: 161 pgs: 8 peering, 27 stale+active+clean, 126 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:13:41.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:41 smithi016 ceph-mon[93192]: osdmap e146: 8 total, 7 up, 8 in 2024-05-06T13:13:41.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:41 smithi016 ceph-mon[93192]: from='client.64354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:41.330 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:41 smithi016 ceph-mon[93192]: pgmap v172: 161 pgs: 8 peering, 27 stale+active+clean, 126 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:13:41.330 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:41 smithi016 podman[143220]: 2024-05-06 13:13:41.062300061 +0000 UTC m=+0.682632726 container died 8f404a27e37cc2f05fb309b15106ca047157d34dc227f9e33ce726dd8a055c6f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:13:41.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:41 smithi016 ceph-mon[102669]: osdmap e146: 8 total, 7 up, 8 in 2024-05-06T13:13:41.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:41 smithi016 ceph-mon[102669]: from='client.64354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:41.331 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:41 smithi016 ceph-mon[102669]: pgmap v172: 161 pgs: 8 peering, 27 stale+active+clean, 126 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:13:41.331 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:13:41.331 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 5s ago 17m - - 2024-05-06T13:13:41.331 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 10s ago 17m - - 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (7m) 5s ago 12m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (7m) 10s ago 11m 52.5M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (6m) 5s ago 10m 61.8M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (6m) 10s ago 16m 524M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (4m) 5s ago 18m 451M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (4m) 5s ago 18m 62.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (3m) 10s ago 16m 49.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (3m) 5s ago 17m 52.4M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (7m) 5s ago 12m 19.3M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (7m) 10s ago 12m 18.2M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (2m) 5s ago 16m 57.5M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (83s) 5s ago 15m 46.0M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (45s) 5s ago 15m 42.6M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:13:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (20s) 5s ago 15m 46.6M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 8dd2cf254139 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (14m) 10s ago 14m 63.1M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (14m) 10s ago 14m 62.1M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (14m) 10s ago 14m 58.0M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (13m) 10s ago 13m 61.5M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (6m) 10s ago 13m 68.5M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (11m) 5s ago 11m 76.1M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (11m) 10s ago 11m 74.0M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (11m) 5s ago 11m 75.8M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:13:41.333 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (11m) 10s ago 11m 73.7M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:13:41.758 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:13:41.758 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:13:41.758 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:13:41.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:13:41.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:13:41.760 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:13:41.870 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:41 smithi016 podman[143289]: 2024-05-06 13:13:41.615030172 +0000 UTC m=+0.546755182 container remove 8f404a27e37cc2f05fb309b15106ca047157d34dc227f9e33ce726dd8a055c6f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-06T13:13:41.870 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:41 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-06T13:13:41.870 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:41 smithi016 systemd[1]: Stopped Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:13:41.871 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:41 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3.service: Consumed 1.943s CPU time. 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "9/23 daemons upgraded", 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:13:42.133 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:13:42.134 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:13:42.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:42 smithi016 ceph-mon[93192]: from='client.44463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:42.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:42 smithi016 ceph-mon[93192]: from='client.44469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:42.134 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:42 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1001868889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:42.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:42 smithi016 ceph-mon[102669]: from='client.44463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:42.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:42 smithi016 ceph-mon[102669]: from='client.44469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:42.134 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:42 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1001868889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:42.135 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:41 smithi016 systemd[1]: Starting Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:13:42.135 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 podman[143460]: 2024-05-06 13:13:42.00393709 +0000 UTC m=+0.018894575 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:13:42.135 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 podman[143460]: 2024-05-06 13:13:42.107816033 +0000 UTC m=+0.122773501 container create c2937f455115515d6690191d638496255528c2b4cebe2fe84ad86001f7b1bae7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953) 2024-05-06T13:13:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:42 smithi186 ceph-mon[83629]: from='client.44463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:42 smithi186 ceph-mon[83629]: from='client.44469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:42 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1001868889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:42.402 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 podman[143460]: 2024-05-06 13:13:42.327780208 +0000 UTC m=+0.342737676 container init c2937f455115515d6690191d638496255528c2b4cebe2fe84ad86001f7b1bae7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:13:42.402 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 podman[143460]: 2024-05-06 13:13:42.331307597 +0000 UTC m=+0.346265072 container start c2937f455115515d6690191d638496255528c2b4cebe2fe84ad86001f7b1bae7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T13:13:42.548 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN 1 osds down 2024-05-06T13:13:42.548 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-06T13:13:42.549 INFO:teuthology.orchestra.run.smithi016.stdout: osd.3 (root=default,host=smithi016) is down 2024-05-06T13:13:42.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 podman[143460]: 2024-05-06 13:13:42.402543468 +0000 UTC m=+0.417500936 container attach c2937f455115515d6690191d638496255528c2b4cebe2fe84ad86001f7b1bae7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:13:43.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:43 smithi016 ceph-mon[93192]: from='client.64378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:43.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:43 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1715347890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:13:43.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:43 smithi016 ceph-mon[93192]: pgmap v173: 161 pgs: 8 peering, 26 stale+active+clean, 6 active+undersized, 121 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:13:43.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:43 smithi016 ceph-mon[102669]: from='client.64378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:43.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:43 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1715347890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:13:43.114 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:43 smithi016 ceph-mon[102669]: pgmap v173: 161 pgs: 8 peering, 26 stale+active+clean, 6 active+undersized, 121 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:13:43.114 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:43.114 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:43.114 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:43.114 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 bash[143460]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate[143477]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-06T13:13:43.115 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:42 smithi016 podman[143460]: 2024-05-06 13:13:42.819259562 +0000 UTC m=+0.834217025 container died c2937f455115515d6690191d638496255528c2b4cebe2fe84ad86001f7b1bae7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-70ce953) 2024-05-06T13:13:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:43 smithi186 ceph-mon[83629]: from='client.64378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:13:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:43 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1715347890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:13:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:43 smithi186 ceph-mon[83629]: pgmap v173: 161 pgs: 8 peering, 26 stale+active+clean, 6 active+undersized, 121 active+clean; 585 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:13:43.838 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:43 smithi016 podman[143637]: 2024-05-06 13:13:43.51527703 +0000 UTC m=+0.690627056 container remove c2937f455115515d6690191d638496255528c2b4cebe2fe84ad86001f7b1bae7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-06T13:13:43.838 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:43 smithi016 podman[143700]: 2024-05-06 13:13:43.732923329 +0000 UTC m=+0.113030038 container create dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-06T13:13:43.839 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:43 smithi016 podman[143700]: 2024-05-06 13:13:43.638385705 +0000 UTC m=+0.018492399 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:13:44.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:43 smithi016 podman[143700]: 2024-05-06 13:13:43.977955289 +0000 UTC m=+0.358061963 container init dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:13:44.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:43 smithi016 podman[143700]: 2024-05-06 13:13:43.981819134 +0000 UTC m=+0.361925803 container start dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-06T13:13:44.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:44 smithi016 ceph-osd[143719]: -- 172.21.15.16:0/1693088530 <== mon.1 v2:172.21.15.16:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ab8eef680 con 0x560ab8eb9000 2024-05-06T13:13:44.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:44 smithi016 bash[143700]: dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 2024-05-06T13:13:44.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:44 smithi016 systemd[1]: Started Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:13:44.923 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:44 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:13:44.534+0000 7f7529e397c0 -1 Falling back to public interface 2024-05-06T13:13:45.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:13:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:13:44] "GET /metrics HTTP/1.1" 200 38520 "" "Prometheus/2.33.4" 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: pgmap v174: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.347 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.348 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.349 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.350 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.351 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.351 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.352 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.353 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.354 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.354 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.354 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.354 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.354 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.354 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.355 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.356 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.357 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: pgmap v174: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:45.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.358 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.359 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.360 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.360 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:45.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: pgmap v174: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:45.361 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.362 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:45.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:45.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:45.363 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:45.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:45.364 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.405 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded (PG_DEGRADED) 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:46.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: pgmap v175: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:47 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.376 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:47 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:13:47.290+0000 7f7529e397c0 -1 osd.3 144 log_to_monitors true 2024-05-06T13:13:47.376 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.377 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.378 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.379 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.380 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.381 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: pgmap v175: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:47.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.390 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:47.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: pgmap v175: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:47.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:47.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:47.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:47 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.095 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.095 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.096 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.097 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:13:48.097 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.097 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.097 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.379 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.425 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.426 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.427 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.428 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.428 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:13:48.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:48.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:48.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:48.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:48.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:48.703 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:13:48 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:13:48.532+0000 7f7517288700 -1 osd.3 144 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:13:49.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: osdmap e147: 8 total, 7 up, 8 in 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: osdmap e147: 8 total, 7 up, 8 in 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: pgmap v177: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: pgmap v177: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-06T13:13:49.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: osdmap e147: 8 total, 7 up, 8 in 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655]' entity='osd.3' 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: pgmap v177: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:49.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:49.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:49.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.283 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.284 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.285 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655] boot 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: osdmap e148: 8 total, 8 up, 8 in 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.286 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.287 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655] boot 2024-05-06T13:13:50.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: osdmap e148: 8 total, 8 up, 8 in 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.289 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.290 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.291 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.293 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.294 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:50 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: osd.3 [v2:172.21.15.16:6824/1415861655,v1:172.21.15.16:6825/1415861655] boot 2024-05-06T13:13:50.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: osdmap e148: 8 total, 8 up, 8 in 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:50.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:50.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:50.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:50.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:50.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:50 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: osdmap e149: 8 total, 8 up, 8 in 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: osdmap e149: 8 total, 8 up, 8 in 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: pgmap v180: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: pgmap v180: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: osdmap e149: 8 total, 8 up, 8 in 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: pgmap v180: 161 pgs: 23 active+undersized+degraded, 43 active+undersized, 95 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:51.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.288 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.289 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.290 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.291 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.292 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.292 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.293 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.294 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.295 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.296 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.297 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.298 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.299 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.300 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.301 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.302 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.303 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.304 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:52 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:52.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:52 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: pgmap v181: 161 pgs: 23 active+undersized+degraded, 38 active+undersized, 100 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: pgmap v181: 161 pgs: 23 active+undersized+degraded, 38 active+undersized, 100 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:53 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: pgmap v181: 161 pgs: 23 active+undersized+degraded, 38 active+undersized, 100 active+clean; 585 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:53.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:53.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:53 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.248 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.249 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.250 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.251 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.252 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.253 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.254 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.255 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.256 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.257 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.257 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.257 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.257 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:54.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:13:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:13:54] "GET /metrics HTTP/1.1" 200 38529 "" "Prometheus/2.33.4" 2024-05-06T13:13:55.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:55.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:55.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:55.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:55.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.166 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded) 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded) 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 77/630 objects degraded (12.222%), 23 pgs degraded) 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:56.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:13:56.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:13:56.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:13:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:13:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[93192]: Upgrade: osd.4 is safe to restart 2024-05-06T13:13:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[93192]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:13:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[102669]: Upgrade: osd.4 is safe to restart 2024-05-06T13:13:57.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:57 smithi016 ceph-mon[102669]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:13:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:57 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:13:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:57 smithi186 ceph-mon[83629]: Upgrade: osd.4 is safe to restart 2024-05-06T13:13:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:57 smithi186 ceph-mon[83629]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:58.998 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: Upgrade: Updating osd.4 2024-05-06T13:13:58.998 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:58.998 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:13:58.998 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:58.999 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: Deploying daemon osd.4 on smithi186 2024-05-06T13:13:58.999 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:58.999 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:58.999 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.088 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: Upgrade: Updating osd.4 2024-05-06T13:13:59.088 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: Deploying daemon osd.4 on smithi186 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: Upgrade: Updating osd.4 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:13:59.089 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:13:59.090 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: Deploying daemon osd.4 on smithi186 2024-05-06T13:13:59.090 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.090 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.090 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.858 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[93192]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:59.858 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.858 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.859 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.859 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[102669]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:13:59.859 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.859 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:13:59.859 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:13:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:59 smithi186 ceph-mon[83629]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:14:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:00.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:13:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:00.894 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:00 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:00.997 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:00 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:00.998 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:00 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:01.239 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:01 smithi186 systemd[1]: Stopping Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:14:01.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[28072]: 2024-05-06T13:14:01.261+0000 7f07aa91e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:14:01.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[28072]: 2024-05-06T13:14:01.261+0000 7f07aa91e700 -1 osd.4 149 *** Got signal Terminated *** 2024-05-06T13:14:01.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[28072]: 2024-05-06T13:14:01.261+0000 7f07aa91e700 -1 osd.4 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:14:02.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:01 smithi186 ceph-mon[83629]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:14:02.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:01 smithi186 ceph-mon[83629]: osd.4 marked itself down and dead 2024-05-06T13:14:02.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:01 smithi016 ceph-mon[93192]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:14:02.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:01 smithi016 ceph-mon[93192]: osd.4 marked itself down and dead 2024-05-06T13:14:02.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:01 smithi016 ceph-mon[102669]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:14:02.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:01 smithi016 ceph-mon[102669]: osd.4 marked itself down and dead 2024-05-06T13:14:02.570 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:02 smithi186 podman[109015]: 2024-05-06 13:14:02.294126109 +0000 UTC m=+1.138138338 container died d02dbef985282b4a470721ac9369f78402069f106f882a11fb90e22f2c140d2a (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, architecture=x86_64, com.redhat.component=centos-stream-container, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870) 2024-05-06T13:14:03.003 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:02 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:03.003 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:02 smithi186 ceph-mon[83629]: osdmap e150: 8 total, 7 up, 8 in 2024-05-06T13:14:03.004 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:02 smithi186 podman[109015]: 2024-05-06 13:14:02.661730018 +0000 UTC m=+1.505742248 container cleanup d02dbef985282b4a470721ac9369f78402069f106f882a11fb90e22f2c140d2a (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, ceph=True, com.redhat.component=centos-stream-container, name=centos-stream, GIT_CLEAN=True, RELEASE=HEAD, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, vcs-type=git, release=754, io.k8s.display-name=CentOS Stream 8) 2024-05-06T13:14:03.004 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:02 smithi186 bash[109015]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4 2024-05-06T13:14:03.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:02 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:03.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:02 smithi016 ceph-mon[93192]: osdmap e150: 8 total, 7 up, 8 in 2024-05-06T13:14:03.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:02 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:03.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:02 smithi016 ceph-mon[102669]: osdmap e150: 8 total, 7 up, 8 in 2024-05-06T13:14:03.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109033]: 2024-05-06 13:14:03.004140731 +0000 UTC m=+0.707259651 container remove d02dbef985282b4a470721ac9369f78402069f106f882a11fb90e22f2c140d2a (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, RELEASE=HEAD, vendor=Red Hat, Inc., io.buildah.version=1.19.8, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-06T13:14:03.562 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109125]: 2024-05-06 13:14:03.213235159 +0000 UTC m=+0.017956091 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:03.562 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109125]: 2024-05-06 13:14:03.339269512 +0000 UTC m=+0.143990436 container create 80e335b3d9c7f87c5008489ae1856c24cef4324a51b29a37dce63877a49e5ef5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-06T13:14:03.562 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109125]: 2024-05-06 13:14:03.559186641 +0000 UTC m=+0.363907572 container init 80e335b3d9c7f87c5008489ae1856c24cef4324a51b29a37dce63877a49e5ef5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-06T13:14:03.562 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109125]: 2024-05-06 13:14:03.562822313 +0000 UTC m=+0.367543241 container start 80e335b3d9c7f87c5008489ae1856c24cef4324a51b29a37dce63877a49e5ef5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-70ce953) 2024-05-06T13:14:03.861 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109125]: 2024-05-06 13:14:03.658799956 +0000 UTC m=+0.463520883 container attach 80e335b3d9c7f87c5008489ae1856c24cef4324a51b29a37dce63877a49e5ef5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-06T13:14:03.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:03 smithi186 ceph-mon[83629]: osdmap e151: 8 total, 7 up, 8 in 2024-05-06T13:14:03.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:03 smithi186 ceph-mon[83629]: pgmap v188: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:14:03.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:03.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:03.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[93192]: osdmap e151: 8 total, 7 up, 8 in 2024-05-06T13:14:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[93192]: pgmap v188: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:14:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[102669]: osdmap e151: 8 total, 7 up, 8 in 2024-05-06T13:14:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[102669]: pgmap v188: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:14:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:04.212 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:03 smithi186 podman[109125]: 2024-05-06 13:14:03.863012457 +0000 UTC m=+0.667733377 container died 80e335b3d9c7f87c5008489ae1856c24cef4324a51b29a37dce63877a49e5ef5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:14:04.462 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 podman[109152]: 2024-05-06 13:14:04.445728917 +0000 UTC m=+0.576611500 container remove 80e335b3d9c7f87c5008489ae1856c24cef4324a51b29a37dce63877a49e5ef5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=squid-70ce953, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-06T13:14:04.462 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4.service: Deactivated successfully. 2024-05-06T13:14:04.462 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 systemd[1]: Stopped Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:14:04.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:14:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:14:04] "GET /metrics HTTP/1.1" 200 38520 "" "Prometheus/2.33.4" 2024-05-06T13:14:04.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4.service: Consumed 11.615s CPU time. 2024-05-06T13:14:04.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 systemd[1]: Starting Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:14:05.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:04 smithi186 ceph-mon[83629]: pgmap v189: 161 pgs: 25 active+undersized+degraded, 4 stale+active+clean, 36 active+undersized, 96 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 101/630 objects degraded (16.032%) 2024-05-06T13:14:05.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:04 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 101/630 objects degraded (16.032%), 25 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:05.144 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 podman[109259]: 2024-05-06 13:14:04.784302845 +0000 UTC m=+0.017930352 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:05.144 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:04 smithi186 podman[109259]: 2024-05-06 13:14:04.905280678 +0000 UTC m=+0.138908186 container create bc4f771ece949f3a3edabd6788fb7295b2e4a0ece4170ed54d32877d820211bf (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-70ce953) 2024-05-06T13:14:05.144 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 podman[109259]: 2024-05-06 13:14:05.144168007 +0000 UTC m=+0.377795523 container init bc4f771ece949f3a3edabd6788fb7295b2e4a0ece4170ed54d32877d820211bf (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, ceph=True) 2024-05-06T13:14:05.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:04 smithi016 ceph-mon[93192]: pgmap v189: 161 pgs: 25 active+undersized+degraded, 4 stale+active+clean, 36 active+undersized, 96 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 101/630 objects degraded (16.032%) 2024-05-06T13:14:05.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:04 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 101/630 objects degraded (16.032%), 25 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:05.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:04 smithi016 ceph-mon[102669]: pgmap v189: 161 pgs: 25 active+undersized+degraded, 4 stale+active+clean, 36 active+undersized, 96 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 101/630 objects degraded (16.032%) 2024-05-06T13:14:05.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:04 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 101/630 objects degraded (16.032%), 25 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:05.506 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 podman[109259]: 2024-05-06 13:14:05.147828508 +0000 UTC m=+0.381456024 container start bc4f771ece949f3a3edabd6788fb7295b2e4a0ece4170ed54d32877d820211bf (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:14:05.506 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 podman[109259]: 2024-05-06 13:14:05.226896009 +0000 UTC m=+0.460523531 container attach bc4f771ece949f3a3edabd6788fb7295b2e4a0ece4170ed54d32877d820211bf (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T13:14:05.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 bash[109259]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:14:05.766 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-05-06T13:14:05.767 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:05.767 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[109274]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-06T13:14:05.767 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:05 smithi186 podman[109259]: 2024-05-06 13:14:05.647492046 +0000 UTC m=+0.881119564 container died bc4f771ece949f3a3edabd6788fb7295b2e4a0ece4170ed54d32877d820211bf (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-06T13:14:06.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:06 smithi186 podman[109405]: 2024-05-06 13:14:06.149310838 +0000 UTC m=+0.530295385 container remove bc4f771ece949f3a3edabd6788fb7295b2e4a0ece4170ed54d32877d820211bf (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-06T13:14:07.128 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:06 smithi186 ceph-mon[83629]: pgmap v190: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:06 smithi016 ceph-mon[93192]: pgmap v190: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:07.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:06 smithi016 ceph-mon[102669]: pgmap v190: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:07.453 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 podman[109487]: 2024-05-06 13:14:07.230435796 +0000 UTC m=+0.019259329 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:07.454 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 podman[109487]: 2024-05-06 13:14:07.347061587 +0000 UTC m=+0.135885156 container create c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:14:07.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 podman[109487]: 2024-05-06 13:14:07.55782497 +0000 UTC m=+0.346648493 container init c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430) 2024-05-06T13:14:07.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 podman[109487]: 2024-05-06 13:14:07.560922734 +0000 UTC m=+0.349746266 container start c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-06T13:14:07.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 ceph-osd[109507]: -- 172.21.15.186:0/42996745 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b99d7f680 con 0x564b99d48c00 2024-05-06T13:14:07.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 bash[109487]: c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 2024-05-06T13:14:07.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:07 smithi186 systemd[1]: Started Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:14:08.477 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:08.100+0000 7ff8e1e677c0 -1 Falling back to public interface 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:08.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:08.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:08.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.099 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.100 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.836 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.836 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.836 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.836 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.836 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.836 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:09.837 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: pgmap v191: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:09.837 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.837 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.837 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.837 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.837 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:09.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:09.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:09.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:09.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:09.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: pgmap v191: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: pgmap v191: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.986 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:10.829+0000 7ff8e1e677c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-05-06T13:14:10.986 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:10.876+0000 7ff8e1e677c0 -1 osd.4 149 log_to_monitors true 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:10.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.983 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:11 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:11.835+0000 7ff8d32be700 -1 osd.4 149 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:14:11.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: pgmap v192: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.984 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:11.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:14:12.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.100 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: pgmap v192: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.101 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.102 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: pgmap v192: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:12.103 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:12.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:12.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:12.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:12.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:14:12.944 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:14:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:12 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:14:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:12 smithi186 ceph-mon[83629]: Upgrade: osd.4 is safe to restart 2024-05-06T13:14:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:12 smithi186 ceph-mon[83629]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:14:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:12 smithi186 ceph-mon[83629]: from='osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:12 smithi186 ceph-mon[83629]: osdmap e152: 8 total, 7 up, 8 in 2024-05-06T13:14:13.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:12 smithi186 ceph-mon[83629]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:14:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[93192]: Upgrade: osd.4 is safe to restart 2024-05-06T13:14:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[93192]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:14:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[93192]: from='osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[93192]: osdmap e152: 8 total, 7 up, 8 in 2024-05-06T13:14:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[93192]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:13.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-06T13:14:13.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[102669]: Upgrade: osd.4 is safe to restart 2024-05-06T13:14:13.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[102669]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:14:13.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[102669]: from='osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:13.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[102669]: osdmap e152: 8 total, 7 up, 8 in 2024-05-06T13:14:13.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:12 smithi016 ceph-mon[102669]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 14s ago 18m - - 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 2s ago 17m - - 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (7m) 14s ago 12m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (7m) 2s ago 12m 53.0M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (6m) 14s ago 11m 64.0M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (7m) 2s ago 17m 526M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:14:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (5m) 14s ago 18m 451M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (5m) 14s ago 19m 63.3M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (3m) 2s ago 17m 52.0M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (4m) 14s ago 17m 54.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (8m) 14s ago 13m 19.1M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (7m) 2s ago 13m 18.5M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (2m) 14s ago 16m 59.7M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (115s) 14s ago 16m 46.7M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (77s) 14s ago 16m 42.8M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (29s) 14s ago 15m 48.2M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (15m) 2s ago 15m 63.8M 4096M 17.2.0 e1d6a67b021e d02dbef98528 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (14m) 2s ago 14m 62.5M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (14m) 2s ago 14m 58.6M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (14m) 2s ago 14m 62.2M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (6m) 2s ago 13m 68.6M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:14:13.627 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (11m) 14s ago 11m 76.2M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:14:13.628 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (11m) 2s ago 11m 74.1M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:14:13.628 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (11m) 14s ago 11m 75.9M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:14:13.628 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (11m) 2s ago 11m 73.8M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:14:13.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[93192]: pgmap v194: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:13.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:14:13.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[93192]: osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120] boot 2024-05-06T13:14:13.945 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[93192]: osdmap e153: 8 total, 8 up, 8 in 2024-05-06T13:14:13.946 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:14:13.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[102669]: pgmap v194: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:13.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:14:13.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[102669]: osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120] boot 2024-05-06T13:14:13.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[102669]: osdmap e153: 8 total, 8 up, 8 in 2024-05-06T13:14:13.946 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:14.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 5 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 10 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:14:14.054 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:14:14.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:13 smithi186 ceph-mon[83629]: pgmap v194: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 108/630 objects degraded (17.143%) 2024-05-06T13:14:14.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:13 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:14:14.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:13 smithi186 ceph-mon[83629]: osd.4 [v2:172.21.15.186:6800/3395249120,v1:172.21.15.186:6801/3395249120] boot 2024-05-06T13:14:14.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:13 smithi186 ceph-mon[83629]: osdmap e153: 8 total, 8 up, 8 in 2024-05-06T13:14:14.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:14:14.398 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:14:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:14:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:14:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:14:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:14:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:14:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:14:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:14:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "9/23 daemons upgraded", 2024-05-06T13:14:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:14:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:14:14.399 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:14:14.824 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:14:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:14:14] "GET /metrics HTTP/1.1" 200 38520 "" "Prometheus/2.33.4" 2024-05-06T13:14:14.827 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded 2024-05-06T13:14:14.827 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded 2024-05-06T13:14:14.827 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.f is active+undersized+degraded, acting [0,7] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.3 is active+undersized+degraded, acting [0,6] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.9 is active+undersized+degraded, acting [2,7] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.14 is active+undersized+degraded, acting [7,6] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 3.1a is active+undersized+degraded, acting [1,2] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 4.9 is active+undersized+degraded, acting [2,3] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 4.d is active+undersized+degraded, acting [2,1] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 4.e is active+undersized+degraded, acting [6,1] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 5.1c is active+undersized+degraded, acting [3,2] 2024-05-06T13:14:14.828 INFO:teuthology.orchestra.run.smithi016.stdout: pg 6.1a is active+undersized+degraded, acting [5,1] 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='client.44499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='client.44505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: osdmap e154: 8 total, 8 up, 8 in 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2530121368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 108/630 objects degraded (17.143%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: Upgrade: Updating osd.4 2024-05-06T13:14:15.146 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:14:15.147 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:15.147 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: Deploying daemon osd.4 on smithi186 2024-05-06T13:14:15.147 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:14 smithi186 ceph-mon[83629]: pgmap v197: 161 pgs: 17 activating, 18 peering, 10 active+undersized+degraded, 17 active+undersized, 99 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:15.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='client.44499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='client.44505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: osdmap e154: 8 total, 8 up, 8 in 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2530121368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 108/630 objects degraded (17.143%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: Upgrade: Updating osd.4 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: Deploying daemon osd.4 on smithi186 2024-05-06T13:14:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[93192]: pgmap v197: 161 pgs: 17 activating, 18 peering, 10 active+undersized+degraded, 17 active+undersized, 99 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='client.44499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='client.44505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: osdmap e154: 8 total, 8 up, 8 in 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2530121368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 108/630 objects degraded (17.143%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: Upgrade: Updating osd.4 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-06T13:14:15.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:15.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: Deploying daemon osd.4 on smithi186 2024-05-06T13:14:15.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:14 smithi016 ceph-mon[102669]: pgmap v197: 161 pgs: 17 activating, 18 peering, 10 active+undersized+degraded, 17 active+undersized, 99 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:16.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:15 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4187492211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:14:16.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:15 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/4187492211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:14:16.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:15 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/4187492211' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:14:16.985 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:16 smithi186 ceph-mon[83629]: pgmap v198: 161 pgs: 17 activating, 18 peering, 10 active+undersized+degraded, 13 active+undersized, 103 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:16 smithi016 ceph-mon[93192]: pgmap v198: 161 pgs: 17 activating, 18 peering, 10 active+undersized+degraded, 13 active+undersized, 103 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:17.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:16 smithi016 ceph-mon[102669]: pgmap v198: 161 pgs: 17 activating, 18 peering, 10 active+undersized+degraded, 13 active+undersized, 103 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:18 smithi186 ceph-mon[83629]: pgmap v199: 161 pgs: 17 activating, 6 peering, 138 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:14:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:19.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:18 smithi016 ceph-mon[93192]: pgmap v199: 161 pgs: 17 activating, 6 peering, 138 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:14:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:18 smithi016 ceph-mon[102669]: pgmap v199: 161 pgs: 17 activating, 6 peering, 138 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:14:19.952 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:19 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded) 2024-05-06T13:14:19.952 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:19 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:14:19.952 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:19.953 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:19.953 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:19.953 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:19 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded) 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:20.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded) 2024-05-06T13:14:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:14:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:19 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:20.982 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:20 smithi186 systemd[1]: Stopping Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:14:21.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:20.980+0000 7ff8d84cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:14:21.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:20.981+0000 7ff8d84cd700 -1 osd.4 154 *** Got signal Terminated *** 2024-05-06T13:14:21.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:20 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[109503]: 2024-05-06T13:14:20.981+0000 7ff8d84cd700 -1 osd.4 154 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:14:21.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: osd.4 marked itself down and dead 2024-05-06T13:14:21.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:21.675 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: osd.4 marked itself down and dead 2024-05-06T13:14:21.676 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: osd.4 marked itself down and dead 2024-05-06T13:14:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:22.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[93192]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:22.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:14:22.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:22.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[93192]: osdmap e155: 8 total, 7 up, 8 in 2024-05-06T13:14:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[102669]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:14:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:22.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:22 smithi016 ceph-mon[102669]: osdmap e155: 8 total, 7 up, 8 in 2024-05-06T13:14:22.683 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:22 smithi186 podman[112034]: 2024-05-06 13:14:22.371576044 +0000 UTC m=+1.522951561 container died c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-06T13:14:22.683 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:22 smithi186 ceph-mon[83629]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:22.683 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:22 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:14:22.683 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:22 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:22.683 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:22 smithi186 ceph-mon[83629]: osdmap e155: 8 total, 7 up, 8 in 2024-05-06T13:14:23.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:22 smithi186 podman[112034]: 2024-05-06 13:14:22.890800941 +0000 UTC m=+2.042176500 container cleanup c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-05-06T13:14:23.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:22 smithi186 bash[112034]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4 2024-05-06T13:14:23.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:23 smithi186 podman[112079]: 2024-05-06 13:14:23.100697221 +0000 UTC m=+0.726453423 container remove c4e9e221cf2d7a4524fcc8a80fa27f6145951c85b1196bf2a9d34c85d6aca6b5 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, ceph=True, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-06T13:14:23.846 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:23 smithi186 podman[112172]: 2024-05-06 13:14:23.419574754 +0000 UTC m=+0.018734803 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:23.846 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:23 smithi186 podman[112172]: 2024-05-06 13:14:23.529700448 +0000 UTC m=+0.128860533 container create 265bbbc4a7d7ba7cc1104e8d31905ec960f0111fcd6e803be44e2bd5e8e5a857 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-06T13:14:23.847 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:23 smithi186 podman[112172]: 2024-05-06 13:14:23.746239902 +0000 UTC m=+0.345399945 container init 265bbbc4a7d7ba7cc1104e8d31905ec960f0111fcd6e803be44e2bd5e8e5a857 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-06T13:14:23.847 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:23 smithi186 podman[112172]: 2024-05-06 13:14:23.749451597 +0000 UTC m=+0.348611649 container start 265bbbc4a7d7ba7cc1104e8d31905ec960f0111fcd6e803be44e2bd5e8e5a857 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953) 2024-05-06T13:14:23.847 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:23 smithi186 podman[112172]: 2024-05-06 13:14:23.846205426 +0000 UTC m=+0.445365484 container attach 265bbbc4a7d7ba7cc1104e8d31905ec960f0111fcd6e803be44e2bd5e8e5a857 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-06T13:14:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:23 smithi186 ceph-mon[83629]: pgmap v203: 161 pgs: 8 peering, 23 stale+active+clean, 130 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-05-06T13:14:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:23 smithi186 ceph-mon[83629]: osdmap e156: 8 total, 7 up, 8 in 2024-05-06T13:14:24.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:24 smithi186 podman[112172]: 2024-05-06 13:14:24.05820576 +0000 UTC m=+0.657365804 container died 265bbbc4a7d7ba7cc1104e8d31905ec960f0111fcd6e803be44e2bd5e8e5a857 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-06T13:14:24.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:23 smithi016 ceph-mon[93192]: pgmap v203: 161 pgs: 8 peering, 23 stale+active+clean, 130 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-05-06T13:14:24.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:23 smithi016 ceph-mon[93192]: osdmap e156: 8 total, 7 up, 8 in 2024-05-06T13:14:24.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:23 smithi016 ceph-mon[102669]: pgmap v203: 161 pgs: 8 peering, 23 stale+active+clean, 130 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-05-06T13:14:24.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:23 smithi016 ceph-mon[102669]: osdmap e156: 8 total, 7 up, 8 in 2024-05-06T13:14:24.716 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:14:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:14:24] "GET /metrics HTTP/1.1" 200 38527 "" "Prometheus/2.33.4" 2024-05-06T13:14:25.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:24 smithi186 podman[112199]: 2024-05-06 13:14:24.717165138 +0000 UTC m=+0.651599414 container remove 265bbbc4a7d7ba7cc1104e8d31905ec960f0111fcd6e803be44e2bd5e8e5a857 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-06T13:14:25.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:24 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4.service: Deactivated successfully. 2024-05-06T13:14:25.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:24 smithi186 systemd[1]: Stopped Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:14:25.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:24 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4.service: Consumed 1.923s CPU time. 2024-05-06T13:14:25.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:24 smithi186 systemd[1]: Starting Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:14:25.345 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:25 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 89/630 objects degraded (14.127%), 22 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:25.346 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 podman[112301]: 2024-05-06 13:14:25.152030171 +0000 UTC m=+0.114688172 container create 5c7642eda9532f67d6b8dec617eaa69e997ff3a54078d8845cc6ceaf265fd496 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953) 2024-05-06T13:14:25.346 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 podman[112301]: 2024-05-06 13:14:25.05602262 +0000 UTC m=+0.018680623 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:25.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:25 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 89/630 objects degraded (14.127%), 22 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:25.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:25 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 89/630 objects degraded (14.127%), 22 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:25.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 podman[112301]: 2024-05-06 13:14:25.346239408 +0000 UTC m=+0.308897410 container init 5c7642eda9532f67d6b8dec617eaa69e997ff3a54078d8845cc6ceaf265fd496 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-06T13:14:25.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 podman[112301]: 2024-05-06 13:14:25.349407881 +0000 UTC m=+0.312065890 container start 5c7642eda9532f67d6b8dec617eaa69e997ff3a54078d8845cc6ceaf265fd496 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-06T13:14:25.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 podman[112301]: 2024-05-06 13:14:25.429430494 +0000 UTC m=+0.392088501 container attach 5c7642eda9532f67d6b8dec617eaa69e997ff3a54078d8845cc6ceaf265fd496 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-06T13:14:26.041 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:26.041 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:26.041 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:26.041 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:26.041 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 bash[112301]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate[112316]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-06T13:14:26.042 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:25 smithi186 podman[112301]: 2024-05-06 13:14:25.823239976 +0000 UTC m=+0.785897976 container died 5c7642eda9532f67d6b8dec617eaa69e997ff3a54078d8845cc6ceaf265fd496 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:14:26.379 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:26 smithi186 ceph-mon[83629]: pgmap v205: 161 pgs: 22 active+undersized+degraded, 8 peering, 6 stale+active+clean, 29 active+undersized, 96 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s; 89/630 objects degraded (14.127%) 2024-05-06T13:14:26.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:26 smithi016 ceph-mon[93192]: pgmap v205: 161 pgs: 22 active+undersized+degraded, 8 peering, 6 stale+active+clean, 29 active+undersized, 96 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s; 89/630 objects degraded (14.127%) 2024-05-06T13:14:26.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:26 smithi016 ceph-mon[102669]: pgmap v205: 161 pgs: 22 active+undersized+degraded, 8 peering, 6 stale+active+clean, 29 active+undersized, 96 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s; 89/630 objects degraded (14.127%) 2024-05-06T13:14:26.661 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:26 smithi186 podman[112449]: 2024-05-06 13:14:26.449984706 +0000 UTC m=+0.616082987 container remove 5c7642eda9532f67d6b8dec617eaa69e997ff3a54078d8845cc6ceaf265fd496 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430) 2024-05-06T13:14:26.927 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:26 smithi186 podman[112515]: 2024-05-06 13:14:26.565572663 +0000 UTC m=+0.018250156 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:26.928 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:26 smithi186 podman[112515]: 2024-05-06 13:14:26.709285668 +0000 UTC m=+0.161963149 container create 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, ceph=True, org.label-schema.schema-version=1.0) 2024-05-06T13:14:27.239 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:26 smithi186 podman[112515]: 2024-05-06 13:14:26.928503333 +0000 UTC m=+0.381180814 container init 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-06T13:14:27.239 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:26 smithi186 podman[112515]: 2024-05-06 13:14:26.931481933 +0000 UTC m=+0.384159414 container start 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-06T13:14:27.239 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:26 smithi186 ceph-osd[112534]: -- 172.21.15.186:0/142302978 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c2d33b680 con 0x556c2d305000 2024-05-06T13:14:27.239 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:27 smithi186 bash[112515]: 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 2024-05-06T13:14:27.240 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:27 smithi186 systemd[1]: Started Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:14:27.490 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:14:27.478+0000 7f666a7b57c0 -1 Falling back to public interface 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: pgmap v206: 161 pgs: 25 active+undersized+degraded, 8 peering, 2 stale+active+clean, 34 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s; 96/630 objects degraded (15.238%) 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: pgmap v207: 161 pgs: 25 active+undersized+degraded, 8 peering, 2 stale+active+clean, 34 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 832 B/s rd, 0 op/s; 96/630 objects degraded (15.238%) 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.177 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.178 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.179 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: pgmap v206: 161 pgs: 25 active+undersized+degraded, 8 peering, 2 stale+active+clean, 34 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s; 96/630 objects degraded (15.238%) 2024-05-06T13:14:28.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: pgmap v207: 161 pgs: 25 active+undersized+degraded, 8 peering, 2 stale+active+clean, 34 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 832 B/s rd, 0 op/s; 96/630 objects degraded (15.238%) 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: pgmap v206: 161 pgs: 25 active+undersized+degraded, 8 peering, 2 stale+active+clean, 34 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s; 96/630 objects degraded (15.238%) 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: pgmap v207: 161 pgs: 25 active+undersized+degraded, 8 peering, 2 stale+active+clean, 34 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 832 B/s rd, 0 op/s; 96/630 objects degraded (15.238%) 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:28.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.366 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.366 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.366 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:14:29.366 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.366 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.366 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.367 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.368 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.369 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:29.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:29.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.231 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.231 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.231 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:30.231 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.231 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: pgmap v208: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 108/630 objects degraded (17.143%) 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.232 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.233 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: pgmap v208: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 108/630 objects degraded (17.143%) 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: pgmap v208: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 108/630 objects degraded (17.143%) 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:30.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:30.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:14:30.247+0000 7f666a7b57c0 -1 osd.4 154 log_to_monitors true 2024-05-06T13:14:31.290 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:14:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:14:31.157+0000 7f665bc0c700 -1 osd.4 154 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:14:31.290 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.290 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 108/630 objects degraded (17.143%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.291 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.292 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.293 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.294 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.295 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 108/630 objects degraded (17.143%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 108/630 objects degraded (17.143%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:31.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:31.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: osdmap e157: 8 total, 7 up, 8 in 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: pgmap v210: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 108/630 objects degraded (17.143%) 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: osdmap e157: 8 total, 7 up, 8 in 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: pgmap v210: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 108/630 objects degraded (17.143%) 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: osdmap e157: 8 total, 7 up, 8 in 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: pgmap v210: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 108/630 objects degraded (17.143%) 2024-05-06T13:14:32.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:32.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752] boot 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: osdmap e158: 8 total, 8 up, 8 in 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752] boot 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: osdmap e158: 8 total, 8 up, 8 in 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:33.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: osd.4 [v2:172.21.15.186:6800/2001062752,v1:172.21.15.186:6801/2001062752] boot 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: osdmap e158: 8 total, 8 up, 8 in 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:33.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: pgmap v212: 161 pgs: 8 peering, 26 active+undersized+degraded, 35 active+undersized, 92 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 831 B/s rd, 0 op/s; 100/630 objects degraded (15.873%) 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: osdmap e159: 8 total, 8 up, 8 in 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: pgmap v212: 161 pgs: 8 peering, 26 active+undersized+degraded, 35 active+undersized, 92 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 831 B/s rd, 0 op/s; 100/630 objects degraded (15.873%) 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: osdmap e159: 8 total, 8 up, 8 in 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: pgmap v212: 161 pgs: 8 peering, 26 active+undersized+degraded, 35 active+undersized, 92 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 831 B/s rd, 0 op/s; 100/630 objects degraded (15.873%) 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: osdmap e159: 8 total, 8 up, 8 in 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:34.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:34.833 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:14:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:14:34] "GET /metrics HTTP/1.1" 200 38384 "" "Prometheus/2.33.4" 2024-05-06T13:14:35.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:35.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: pgmap v214: 161 pgs: 8 peering, 10 active+undersized+degraded, 17 active+undersized, 126 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.211 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.213 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.214 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.215 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: pgmap v214: 161 pgs: 8 peering, 10 active+undersized+degraded, 17 active+undersized, 126 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: pgmap v214: 161 pgs: 8 peering, 10 active+undersized+degraded, 17 active+undersized, 126 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 29/630 objects degraded (4.603%) 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:36.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.451 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:37.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: pgmap v215: 161 pgs: 8 peering, 153 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.392 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.393 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.394 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded) 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.396 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.396 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: pgmap v215: 161 pgs: 8 peering, 153 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: pgmap v215: 161 pgs: 8 peering, 153 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded) 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/630 objects degraded (4.603%), 10 pgs degraded) 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.521 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:39.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:39.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:39.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:39.522 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:39.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.228 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.228 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.411 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.412 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.413 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.414 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:40.414 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:14:40.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.415 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.416 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.417 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.418 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.419 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.420 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.421 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:40.422 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:42.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:42.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: Upgrade: osd.5 is safe to restart 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:42.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: Upgrade: osd.5 is safe to restart 2024-05-06T13:14:42.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:42 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:14:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:14:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:42.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:14:42.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:14:42.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: Upgrade: osd.5 is safe to restart 2024-05-06T13:14:42.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:42 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:14:44.832 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:14:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:14:44] "GET /metrics HTTP/1.1" 200 38384 "" "Prometheus/2.33.4" 2024-05-06T13:14:44.833 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:44 smithi186 ceph-mon[83629]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:14:44.833 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:44.833 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:44.833 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:44 smithi186 ceph-mon[83629]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:14:44.833 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[93192]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:14:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[93192]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:14:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[102669]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:14:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[102669]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-06T13:14:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:45.203 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:14:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:14:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 6s ago 18m - - 2024-05-06T13:14:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 0s ago 18m - - 2024-05-06T13:14:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (8m) 6s ago 13m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:14:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (8m) 0s ago 12m 52.3M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:14:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (7m) 6s ago 11m 64.0M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (7m) 0s ago 17m 530M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (5m) 6s ago 19m 452M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (5m) 6s ago 19m 66.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (4m) 0s ago 18m 52.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (4m) 6s ago 18m 57.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (8m) 6s ago 13m 19.0M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (8m) 0s ago 13m 18.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (3m) 6s ago 17m 60.7M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (2m) 6s ago 17m 49.7M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (109s) 6s ago 16m 44.8M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (62s) 6s ago 16m 50.6M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (19s) 0s ago 15m 43.2M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (15m) 0s ago 15m 63.1M 4096M 17.2.0 e1d6a67b021e 0baa48f11647 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (15m) 0s ago 15m 60.6M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:14:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (14m) 0s ago 14m 63.8M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:14:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (7m) 0s ago 14m 68.7M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:14:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (12m) 6s ago 12m 76.4M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:14:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (12m) 0s ago 12m 74.5M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:14:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (12m) 6s ago 12m 76.1M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:14:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (12m) 0s ago 12m 74.1M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:14:46.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:14:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:14:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:46.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:14:46.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-05-06T13:14:46.294 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 5 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 10 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:14:46.295 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:14:46.642 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:14:46.642 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:14:46.642 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:14:46.642 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:14:46.642 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "10/23 daemons upgraded", 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:14:46.643 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:14:46.830 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:46 smithi186 ceph-mon[83629]: from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:46.830 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:46 smithi186 ceph-mon[83629]: Upgrade: Updating osd.5 2024-05-06T13:14:46.830 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:46 smithi186 ceph-mon[83629]: Deploying daemon osd.5 on smithi186 2024-05-06T13:14:46.830 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:46 smithi186 ceph-mon[83629]: from='client.64441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:46.830 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:46 smithi186 ceph-mon[83629]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:46.830 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:46 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1708569084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:46.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[93192]: from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:46.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[93192]: Upgrade: Updating osd.5 2024-05-06T13:14:46.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[93192]: Deploying daemon osd.5 on smithi186 2024-05-06T13:14:46.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[93192]: from='client.64441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:46.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[93192]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1708569084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[102669]: from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[102669]: Upgrade: Updating osd.5 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[102669]: Deploying daemon osd.5 on smithi186 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[102669]: from='client.64441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[102669]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:46.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:46 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1708569084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:47.058 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:14:47.934 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:47 smithi186 ceph-mon[83629]: from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:47.934 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:47 smithi186 ceph-mon[83629]: from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:47.934 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:47 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/862733952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:14:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:47 smithi016 ceph-mon[93192]: from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:47 smithi016 ceph-mon[93192]: from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:47 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/862733952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:14:48.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:47 smithi016 ceph-mon[102669]: from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:48.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:47 smithi016 ceph-mon[102669]: from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:14:48.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:47 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/862733952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:14:48.996 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:48 smithi186 ceph-mon[83629]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:48.996 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:48.996 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:48.996 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[93192]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[102669]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:14:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:49.265 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:49 smithi186 systemd[1]: Stopping Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:14:49.754 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[30955]: 2024-05-06T13:14:49.367+0000 7f26857b7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:14:49.754 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[30955]: 2024-05-06T13:14:49.367+0000 7f26857b7700 -1 osd.5 159 *** Got signal Terminated *** 2024-05-06T13:14:49.754 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[30955]: 2024-05-06T13:14:49.367+0000 7f26857b7700 -1 osd.5 159 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:14:50.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:49 smithi186 ceph-mon[83629]: osd.5 marked itself down and dead 2024-05-06T13:14:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:49 smithi016 ceph-mon[93192]: osd.5 marked itself down and dead 2024-05-06T13:14:50.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:49 smithi016 ceph-mon[102669]: osd.5 marked itself down and dead 2024-05-06T13:14:50.459 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:50 smithi186 podman[118681]: 2024-05-06 13:14:50.196038371 +0000 UTC m=+0.951743952 container died 0baa48f1164770b029b3e961559e9ffa46b4903fddb2e00c86767bb1cc3c94c5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , name=centos-stream, distribution-scope=public, RELEASE=HEAD, vendor=Red Hat, Inc., release=754, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, vcs-type=git, ceph=True, com.redhat.component=centos-stream-container, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=) 2024-05-06T13:14:50.759 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:50 smithi186 podman[118681]: 2024-05-06 13:14:50.558435458 +0000 UTC m=+1.314141039 container cleanup 0baa48f1164770b029b3e961559e9ffa46b4903fddb2e00c86767bb1cc3c94c5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, ceph=True, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, vendor=Red Hat, Inc., io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, GIT_BRANCH=HEAD) 2024-05-06T13:14:50.759 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:50 smithi186 bash[118681]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5 2024-05-06T13:14:51.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:51.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:50 smithi186 ceph-mon[83629]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:51.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:50 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:51.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:50 smithi186 ceph-mon[83629]: osdmap e160: 8 total, 7 up, 8 in 2024-05-06T13:14:51.015 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:50 smithi186 podman[118699]: 2024-05-06 13:14:50.843704895 +0000 UTC m=+0.644621425 container remove 0baa48f1164770b029b3e961559e9ffa46b4903fddb2e00c86767bb1cc3c94c5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, io.openshift.tags=base centos centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, maintainer=Guillaume Abrioux , name=centos-stream, io.openshift.expose-services=) 2024-05-06T13:14:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[93192]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[93192]: osdmap e160: 8 total, 7 up, 8 in 2024-05-06T13:14:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:14:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[102669]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-05-06T13:14:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:14:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:50 smithi016 ceph-mon[102669]: osdmap e160: 8 total, 7 up, 8 in 2024-05-06T13:14:51.471 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:51 smithi186 podman[118791]: 2024-05-06 13:14:51.079301316 +0000 UTC m=+0.017396556 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:51.472 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:51 smithi186 podman[118791]: 2024-05-06 13:14:51.194793659 +0000 UTC m=+0.132888887 container create 7532e6847ac9fd3684df273007b5ba40a70c7a1efd61e04320e071c75729ec17 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=squid-70ce953) 2024-05-06T13:14:51.472 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:51 smithi186 podman[118791]: 2024-05-06 13:14:51.389481924 +0000 UTC m=+0.327577160 container init 7532e6847ac9fd3684df273007b5ba40a70c7a1efd61e04320e071c75729ec17 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-06T13:14:51.472 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:51 smithi186 podman[118791]: 2024-05-06 13:14:51.392791712 +0000 UTC m=+0.330886951 container start 7532e6847ac9fd3684df273007b5ba40a70c7a1efd61e04320e071c75729ec17 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430) 2024-05-06T13:14:51.472 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:51 smithi186 podman[118791]: 2024-05-06 13:14:51.472307722 +0000 UTC m=+0.410402952 container attach 7532e6847ac9fd3684df273007b5ba40a70c7a1efd61e04320e071c75729ec17 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-06T13:14:51.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:51 smithi186 podman[118791]: 2024-05-06 13:14:51.682626415 +0000 UTC m=+0.620721645 container died 7532e6847ac9fd3684df273007b5ba40a70c7a1efd61e04320e071c75729ec17 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430) 2024-05-06T13:14:52.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:51 smithi186 ceph-mon[83629]: osdmap e161: 8 total, 7 up, 8 in 2024-05-06T13:14:52.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:51 smithi016 ceph-mon[93192]: osdmap e161: 8 total, 7 up, 8 in 2024-05-06T13:14:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:51 smithi016 ceph-mon[102669]: osdmap e161: 8 total, 7 up, 8 in 2024-05-06T13:14:52.748 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 podman[118817]: 2024-05-06 13:14:52.301477298 +0000 UTC m=+0.613752249 container remove 7532e6847ac9fd3684df273007b5ba40a70c7a1efd61e04320e071c75729ec17 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-06T13:14:52.748 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5.service: Deactivated successfully. 2024-05-06T13:14:52.749 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 systemd[1]: Stopped Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:14:52.749 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5.service: Consumed 10.281s CPU time. 2024-05-06T13:14:52.749 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 systemd[1]: Starting Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:14:53.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:52 smithi186 ceph-mon[83629]: pgmap v225: 161 pgs: 4 active+undersized+degraded, 16 stale+active+clean, 11 active+undersized, 130 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 15/630 objects degraded (2.381%) 2024-05-06T13:14:53.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:52 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 15/630 objects degraded (2.381%), 4 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:53.015 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 podman[118921]: 2024-05-06 13:14:52.651409717 +0000 UTC m=+0.018271263 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:53.015 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:52 smithi186 podman[118921]: 2024-05-06 13:14:52.78586041 +0000 UTC m=+0.152721964 container create 8048a8982295ad2470317fc8c3a7524afc6472888e5161c0012adeb333970f2e (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-70ce953, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:14:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:52 smithi016 ceph-mon[93192]: pgmap v225: 161 pgs: 4 active+undersized+degraded, 16 stale+active+clean, 11 active+undersized, 130 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 15/630 objects degraded (2.381%) 2024-05-06T13:14:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:52 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 15/630 objects degraded (2.381%), 4 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:53.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:52 smithi016 ceph-mon[102669]: pgmap v225: 161 pgs: 4 active+undersized+degraded, 16 stale+active+clean, 11 active+undersized, 130 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 15/630 objects degraded (2.381%) 2024-05-06T13:14:53.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:52 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 15/630 objects degraded (2.381%), 4 pgs degraded (PG_DEGRADED) 2024-05-06T13:14:53.506 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 podman[118921]: 2024-05-06 13:14:53.063787017 +0000 UTC m=+0.430648564 container init 8048a8982295ad2470317fc8c3a7524afc6472888e5161c0012adeb333970f2e (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-05-06T13:14:53.507 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 podman[118921]: 2024-05-06 13:14:53.067120941 +0000 UTC m=+0.433982495 container start 8048a8982295ad2470317fc8c3a7524afc6472888e5161c0012adeb333970f2e (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-06T13:14:53.507 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 podman[118921]: 2024-05-06 13:14:53.147086419 +0000 UTC m=+0.513947971 container attach 8048a8982295ad2470317fc8c3a7524afc6472888e5161c0012adeb333970f2e (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-05-06T13:14:53.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:14:53.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 bash[118921]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[118935]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-06T13:14:53.767 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:53 smithi186 podman[118921]: 2024-05-06 13:14:53.532715316 +0000 UTC m=+0.899576862 container died 8048a8982295ad2470317fc8c3a7524afc6472888e5161c0012adeb333970f2e (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-06T13:14:54.440 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 podman[119058]: 2024-05-06 13:14:54.134434718 +0000 UTC m=+0.592877011 container remove 8048a8982295ad2470317fc8c3a7524afc6472888e5161c0012adeb333970f2e (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:14:54.440 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 podman[119120]: 2024-05-06 13:14:54.335330382 +0000 UTC m=+0.102707581 container create 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:14:54.440 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 podman[119120]: 2024-05-06 13:14:54.250743963 +0000 UTC m=+0.018121175 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:14:54.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:14:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:14:54] "GET /metrics HTTP/1.1" 200 38528 "" "Prometheus/2.33.4" 2024-05-06T13:14:54.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 podman[119120]: 2024-05-06 13:14:54.579871597 +0000 UTC m=+0.347248799 container init 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-06T13:14:54.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 podman[119120]: 2024-05-06 13:14:54.583320829 +0000 UTC m=+0.350698034 container start 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-06T13:14:54.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 ceph-osd[119139]: -- 172.21.15.186:0/2743679397 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a30f6a7680 con 0x55a30f671400 2024-05-06T13:14:54.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 bash[119120]: 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f 2024-05-06T13:14:54.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:54 smithi186 systemd[1]: Started Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:14:55.127 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:54 smithi186 ceph-mon[83629]: pgmap v226: 161 pgs: 11 active+undersized+degraded, 6 stale+active+clean, 27 active+undersized, 117 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 45/630 objects degraded (7.143%) 2024-05-06T13:14:55.127 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:55.127 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:55.127 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:54 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:55.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[93192]: pgmap v226: 161 pgs: 11 active+undersized+degraded, 6 stale+active+clean, 27 active+undersized, 117 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 45/630 objects degraded (7.143%) 2024-05-06T13:14:55.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:55.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:55.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[102669]: pgmap v226: 161 pgs: 11 active+undersized+degraded, 6 stale+active+clean, 27 active+undersized, 117 active+clean; 585 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 45/630 objects degraded (7.143%) 2024-05-06T13:14:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:55.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:54 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:55.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:14:55.127+0000 7f4cd60687c0 -1 Falling back to public interface 2024-05-06T13:14:56.036 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.036 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.037 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.038 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.039 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:56.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: pgmap v227: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.074 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.075 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.076 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.077 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: pgmap v227: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: pgmap v227: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:14:57.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.979 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:14:57.863+0000 7f4cd60687c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-05-06T13:14:57.980 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:14:57.896+0000 7f4cd60687c0 -1 osd.5 159 log_to_monitors true 2024-05-06T13:14:57.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:57.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:58.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: pgmap v228: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.138 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.139 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: pgmap v228: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.140 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.141 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.142 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.145 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.146 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.203 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:14:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:14:58.834+0000 7f4cc74bf700 -1 osd.5 159 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:14:59.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: pgmap v228: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:14:59.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:14:59.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:14:59.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:14:59.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:14:59.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: osdmap e162: 8 total, 7 up, 8 in 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:00.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: osdmap e162: 8 total, 7 up, 8 in 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 75/630 objects degraded (11.905%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 75/630 objects degraded (11.905%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.186 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:14:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: osdmap e162: 8 total, 7 up, 8 in 2024-05-06T13:15:00.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 75/630 objects degraded (11.905%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:14:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.893 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.894 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: pgmap v230: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553] boot 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: osdmap e163: 8 total, 8 up, 8 in 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.895 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.896 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: pgmap v230: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553] boot 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: osdmap e163: 8 total, 8 up, 8 in 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.897 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.898 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.899 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.900 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.901 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.902 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.903 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:00.903 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:00.903 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:00.903 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:00.903 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:00.903 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: pgmap v230: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 75/630 objects degraded (11.905%) 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: osd.5 [v2:172.21.15.186:6808/1769390553,v1:172.21.15.186:6809/1769390553] boot 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: osdmap e163: 8 total, 8 up, 8 in 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: osdmap e164: 8 total, 8 up, 8 in 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: osdmap e164: 8 total, 8 up, 8 in 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:01.931 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: osdmap e164: 8 total, 8 up, 8 in 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:02.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:02.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: pgmap v233: 161 pgs: 4 activating, 20 active+undersized+degraded, 29 active+undersized, 108 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 74/630 objects degraded (11.746%) 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: pgmap v233: 161 pgs: 4 activating, 20 active+undersized+degraded, 29 active+undersized, 108 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 74/630 objects degraded (11.746%) 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: pgmap v233: 161 pgs: 4 activating, 20 active+undersized+degraded, 29 active+undersized, 108 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 74/630 objects degraded (11.746%) 2024-05-06T13:15:03.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:03.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:03.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:03.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:03.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.143 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.144 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.145 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:04.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:04.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:04.817 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:15:04] "GET /metrics HTTP/1.1" 200 38392 "" "Prometheus/2.33.4" 2024-05-06T13:15:05.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: pgmap v234: 161 pgs: 4 activating, 17 active+undersized+degraded, 19 active+undersized, 121 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 58/630 objects degraded (9.206%) 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: pgmap v234: 161 pgs: 4 activating, 17 active+undersized+degraded, 19 active+undersized, 121 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 58/630 objects degraded (9.206%) 2024-05-06T13:15:05.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 74/630 objects degraded (11.746%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 74/630 objects degraded (11.746%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: pgmap v234: 161 pgs: 4 activating, 17 active+undersized+degraded, 19 active+undersized, 121 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 58/630 objects degraded (9.206%) 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 74/630 objects degraded (11.746%), 20 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:05.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:05.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:05.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:05.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:15:05.340+0000 7f9a35e30700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-05-06T13:15:06.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:06.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.241 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:06.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:06.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:06.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-05-06T13:15:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: pgmap v235: 161 pgs: 4 activating, 157 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 441 B/s rd, 0 op/s 2024-05-06T13:15:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/630 objects degraded (9.206%), 17 pgs degraded) 2024-05-06T13:15:07.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:06 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:15:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-05-06T13:15:07.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: pgmap v235: 161 pgs: 4 activating, 157 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 441 B/s rd, 0 op/s 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/630 objects degraded (9.206%), 17 pgs degraded) 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: pgmap v235: 161 pgs: 4 activating, 157 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 441 B/s rd, 0 op/s 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/630 objects degraded (9.206%), 17 pgs degraded) 2024-05-06T13:15:07.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:06 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:15:09.123 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:08 smithi186 ceph-mon[83629]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-05-06T13:15:09.123 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.123 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.123 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[93192]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-05-06T13:15:09.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.147 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.148 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[102669]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-05-06T13:15:09.148 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.148 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:09.148 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:09 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:09 smithi186 ceph-mon[83629]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-05-06T13:15:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[93192]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-05-06T13:15:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:10.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:09 smithi016 ceph-mon[102669]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-05-06T13:15:13.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:12 smithi016 ceph-mon[93192]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-05-06T13:15:13.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:12 smithi016 ceph-mon[102669]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-05-06T13:15:13.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:12 smithi186 ceph-mon[83629]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 748 B/s rd, 0 op/s 2024-05-06T13:15:14.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:14.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:14 smithi016 ceph-mon[93192]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:15:14.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:14.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:14 smithi016 ceph-mon[102669]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:15:14.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:14.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:14 smithi186 ceph-mon[83629]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:15:15.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:15:14] "GET /metrics HTTP/1.1" 200 38392 "" "Prometheus/2.33.4" 2024-05-06T13:15:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:16 smithi016 ceph-mon[93192]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:15:17.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:16 smithi016 ceph-mon[102669]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:15:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:16 smithi186 ceph-mon[83629]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:15:17.434 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 18s ago 19m - - 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 9s ago 18m - - 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (9m) 18s ago 13m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (8m) 9s ago 13m 52.3M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (7m) 18s ago 12m 64.0M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:15:18.113 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (8m) 9s ago 18m 531M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (6m) 18s ago 20m 452M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (6m) 18s ago 20m 65.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (5m) 9s ago 18m 52.9M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (5m) 18s ago 18m 55.6M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (9m) 18s ago 14m 21.0M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (8m) 9s ago 14m 20.4M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (3m) 18s ago 17m 62.2M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (2m) 18s ago 17m 50.5M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (2m) 18s ago 17m 45.0M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:15:18.114 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (94s) 18s ago 16m 51.1M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (51s) 9s ago 16m 45.1M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (23s) 9s ago 16m 43.0M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 13e785bf6a9a 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (15m) 9s ago 15m 62.0M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (15m) 9s ago 15m 65.0M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (7m) 9s ago 14m 68.8M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (12m) 18s ago 12m 76.6M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (12m) 9s ago 12m 74.6M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (12m) 18s ago 12m 76.2M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:15:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (12m) 9s ago 12m 74.3M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:15:18.520 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:15:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:15:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:15:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:15:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:15:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 6 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:15:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:15:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-05-06T13:15:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 11 2024-05-06T13:15:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:15:18.523 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:15:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:15:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "11/23 daemons upgraded", 2024-05-06T13:15:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:15:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:15:18.878 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:15:19.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[93192]: from='client.44577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:19.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[93192]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:19.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[93192]: from='client.44583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:19.150 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2086320702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[102669]: from='client.44577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[102669]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[102669]: from='client.44583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:19.151 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:18 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2086320702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:18 smithi186 ceph-mon[83629]: from='client.44577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:18 smithi186 ceph-mon[83629]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:18 smithi186 ceph-mon[83629]: from='client.44583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:18 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2086320702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:19.291 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:15:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[93192]: from='client.44589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4071931532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:15:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[102669]: from='client.44589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/4071931532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:15:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:19 smithi186 ceph-mon[83629]: from='client.44589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:19 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/4071931532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:15:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:21.079 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:20 smithi186 ceph-mon[83629]: from='client.44601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:21.079 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:20 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:21.079 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:20 smithi186 ceph-mon[83629]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:21.079 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[93192]: from='client.44601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[93192]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[102669]: from='client.44601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[102669]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:22.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:21 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:22.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:21 smithi016 ceph-mon[93192]: Upgrade: osd.5 is safe to restart 2024-05-06T13:15:22.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:21 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:22.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:21 smithi016 ceph-mon[102669]: Upgrade: osd.5 is safe to restart 2024-05-06T13:15:22.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:21 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-06T13:15:22.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:21 smithi186 ceph-mon[83629]: Upgrade: osd.5 is safe to restart 2024-05-06T13:15:22.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:22 smithi186 ceph-mon[83629]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:22.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:15:22.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:23.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:22 smithi016 ceph-mon[93192]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:23.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:15:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:23.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:22 smithi016 ceph-mon[102669]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:23.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-06T13:15:23.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:23.991 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:23 smithi016 ceph-mon[93192]: Upgrade: Updating osd.5 2024-05-06T13:15:23.991 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:23 smithi016 ceph-mon[93192]: Deploying daemon osd.5 on smithi186 2024-05-06T13:15:23.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:23 smithi016 ceph-mon[102669]: Upgrade: Updating osd.5 2024-05-06T13:15:23.991 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:23 smithi016 ceph-mon[102669]: Deploying daemon osd.5 on smithi186 2024-05-06T13:15:24.112 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:23 smithi186 ceph-mon[83629]: Upgrade: Updating osd.5 2024-05-06T13:15:24.112 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:23 smithi186 ceph-mon[83629]: Deploying daemon osd.5 on smithi186 2024-05-06T13:15:24.831 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:15:24] "GET /metrics HTTP/1.1" 200 38533 "" "Prometheus/2.33.4" 2024-05-06T13:15:25.081 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:24 smithi186 ceph-mon[83629]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:25.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:24 smithi016 ceph-mon[93192]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:25.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:24 smithi016 ceph-mon[102669]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:25.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:25 smithi186 systemd[1]: Stopping Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:15:26.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:25 smithi186 ceph-mon[83629]: osd.5 marked itself down and dead 2024-05-06T13:15:26.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:25 smithi186 ceph-mon[83629]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:26.015 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:15:25.700+0000 7f4ccc6ce700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:15:26.016 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:15:25.700+0000 7f4ccc6ce700 -1 osd.5 164 *** Got signal Terminated *** 2024-05-06T13:15:26.016 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[119134]: 2024-05-06T13:15:25.700+0000 7f4ccc6ce700 -1 osd.5 164 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:15:26.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:25 smithi016 ceph-mon[93192]: osd.5 marked itself down and dead 2024-05-06T13:15:26.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:25 smithi016 ceph-mon[93192]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:26.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:25 smithi016 ceph-mon[102669]: osd.5 marked itself down and dead 2024-05-06T13:15:26.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:25 smithi016 ceph-mon[102669]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:26.439 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:26 smithi186 podman[124190]: 2024-05-06 13:15:26.16091969 +0000 UTC m=+0.737259497 container died 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:15:26.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:26 smithi186 podman[124190]: 2024-05-06 13:15:26.630469463 +0000 UTC m=+1.206809269 container cleanup 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-06T13:15:26.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:26 smithi186 bash[124190]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5 2024-05-06T13:15:27.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:26 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:15:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:26 smithi016 ceph-mon[93192]: osdmap e165: 8 total, 7 up, 8 in 2024-05-06T13:15:27.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:26 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:15:27.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:26 smithi016 ceph-mon[102669]: osdmap e165: 8 total, 7 up, 8 in 2024-05-06T13:15:27.179 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:26 smithi186 podman[124207]: 2024-05-06 13:15:26.890661891 +0000 UTC m=+0.726321698 container remove 13e785bf6a9ac6ca06b2eafdef9708f5e811ac78b0eecc4ce9d071268a00fe3f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, ceph=True) 2024-05-06T13:15:27.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:26 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:15:27.180 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:26 smithi186 ceph-mon[83629]: osdmap e165: 8 total, 7 up, 8 in 2024-05-06T13:15:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:27 smithi016 ceph-mon[93192]: osdmap e166: 8 total, 7 up, 8 in 2024-05-06T13:15:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:27 smithi016 ceph-mon[93192]: pgmap v248: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:15:28.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:27 smithi016 ceph-mon[102669]: osdmap e166: 8 total, 7 up, 8 in 2024-05-06T13:15:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:27 smithi016 ceph-mon[102669]: pgmap v248: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:15:28.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:27 smithi186 ceph-mon[83629]: osdmap e166: 8 total, 7 up, 8 in 2024-05-06T13:15:28.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:27 smithi186 ceph-mon[83629]: pgmap v248: 161 pgs: 6 peering, 21 stale+active+clean, 134 active+clean; 585 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-06T13:15:28.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:28 smithi186 podman[124333]: 2024-05-06 13:15:28.139960818 +0000 UTC m=+0.018159559 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:15:28.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:28 smithi186 podman[124333]: 2024-05-06 13:15:28.281778934 +0000 UTC m=+0.159977661 container create e1b9e7afc183665c9086881ef2c44602e5f062d0ada7df2192eaa47e6a311f04 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-06T13:15:28.836 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:28 smithi186 podman[124333]: 2024-05-06 13:15:28.528917826 +0000 UTC m=+0.407116553 container init e1b9e7afc183665c9086881ef2c44602e5f062d0ada7df2192eaa47e6a311f04 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-06T13:15:28.836 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:28 smithi186 podman[124333]: 2024-05-06 13:15:28.532356223 +0000 UTC m=+0.410554959 container start e1b9e7afc183665c9086881ef2c44602e5f062d0ada7df2192eaa47e6a311f04 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-06T13:15:28.836 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:28 smithi186 podman[124333]: 2024-05-06 13:15:28.626271556 +0000 UTC m=+0.504470299 container attach e1b9e7afc183665c9086881ef2c44602e5f062d0ada7df2192eaa47e6a311f04 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-06T13:15:29.121 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:28 smithi186 podman[124333]: 2024-05-06 13:15:28.836544269 +0000 UTC m=+0.714742997 container died e1b9e7afc183665c9086881ef2c44602e5f062d0ada7df2192eaa47e6a311f04 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:15:29.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 podman[124359]: 2024-05-06 13:15:29.413741628 +0000 UTC m=+0.571141579 container remove e1b9e7afc183665c9086881ef2c44602e5f062d0ada7df2192eaa47e6a311f04 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-06T13:15:29.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5.service: Deactivated successfully. 2024-05-06T13:15:29.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 systemd[1]: Stopped Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:15:29.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5.service: Consumed 1.912s CPU time. 2024-05-06T13:15:29.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 systemd[1]: Starting Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:15:30.108 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.108 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.108 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:30 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.108 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:30.108 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:30 smithi186 ceph-mon[83629]: pgmap v249: 161 pgs: 17 active+undersized+degraded, 6 peering, 5 stale+active+clean, 27 active+undersized, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:15:30.109 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 podman[124487]: 2024-05-06 13:15:29.751087717 +0000 UTC m=+0.018342530 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:15:30.109 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:29 smithi186 podman[124487]: 2024-05-06 13:15:29.889738907 +0000 UTC m=+0.156993711 container create 0ab0cf656076009af2911ad7a53300d67a5b41baa7cbbad154ba49a54876a88f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-06T13:15:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[93192]: pgmap v249: 161 pgs: 17 active+undersized+degraded, 6 peering, 5 stale+active+clean, 27 active+undersized, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:30.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:30 smithi016 ceph-mon[102669]: pgmap v249: 161 pgs: 17 active+undersized+degraded, 6 peering, 5 stale+active+clean, 27 active+undersized, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 60/630 objects degraded (9.524%) 2024-05-06T13:15:30.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 podman[124487]: 2024-05-06 13:15:30.109098645 +0000 UTC m=+0.376353448 container init 0ab0cf656076009af2911ad7a53300d67a5b41baa7cbbad154ba49a54876a88f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-70ce953, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:15:30.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 podman[124487]: 2024-05-06 13:15:30.112373237 +0000 UTC m=+0.379628045 container start 0ab0cf656076009af2911ad7a53300d67a5b41baa7cbbad154ba49a54876a88f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-06T13:15:30.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 podman[124487]: 2024-05-06 13:15:30.19247777 +0000 UTC m=+0.459732580 container attach 0ab0cf656076009af2911ad7a53300d67a5b41baa7cbbad154ba49a54876a88f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 bash[124487]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-06T13:15:30.888 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-06T13:15:30.889 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-06T13:15:30.889 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-05-06T13:15:30.889 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T13:15:30.889 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate[124502]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-06T13:15:30.889 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:30 smithi186 podman[124487]: 2024-05-06 13:15:30.580300019 +0000 UTC m=+0.847554831 container died 0ab0cf656076009af2911ad7a53300d67a5b41baa7cbbad154ba49a54876a88f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-06T13:15:31.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:31 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 60/630 objects degraded (9.524%), 17 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:31.325 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:31 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 60/630 objects degraded (9.524%), 17 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:31.325 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:31 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 60/630 objects degraded (9.524%), 17 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:31.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 podman[124634]: 2024-05-06 13:15:31.263359033 +0000 UTC m=+0.674544900 container remove 0ab0cf656076009af2911ad7a53300d67a5b41baa7cbbad154ba49a54876a88f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-05-06T13:15:31.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 podman[124700]: 2024-05-06 13:15:31.380148607 +0000 UTC m=+0.018207889 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:15:31.783 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 podman[124700]: 2024-05-06 13:15:31.525782995 +0000 UTC m=+0.163842269 container create ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, ceph=True) 2024-05-06T13:15:31.783 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 podman[124700]: 2024-05-06 13:15:31.760488204 +0000 UTC m=+0.398547477 container init ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T13:15:31.783 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 podman[124700]: 2024-05-06 13:15:31.763512623 +0000 UTC m=+0.401571897 container start ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-06T13:15:32.062 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 ceph-osd[124719]: -- 172.21.15.186:0/291212600 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561317221680 con 0x5613171eac00 2024-05-06T13:15:32.062 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 bash[124700]: ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 2024-05-06T13:15:32.062 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:31 smithi186 systemd[1]: Started Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[93192]: pgmap v250: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[102669]: pgmap v250: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:32.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.321 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:15:32.304+0000 7f4a2aa6a7c0 -1 Falling back to public interface 2024-05-06T13:15:32.321 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:32 smithi186 ceph-mon[83629]: pgmap v250: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:32.321 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.321 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:32.321 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:32.321 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:32 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:32.322 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.160 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:33.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:33.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:33.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.223 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.224 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.225 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: pgmap v251: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.226 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.227 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: pgmap v251: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: pgmap v251: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:34.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:34.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:34.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:34.954 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:15:34] "GET /metrics HTTP/1.1" 200 38538 "" "Prometheus/2.33.4" 2024-05-06T13:15:35.265 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:15:35.048+0000 7f4a2aa6a7c0 -1 osd.5 164 log_to_monitors true 2024-05-06T13:15:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:15:35.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:35 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:15:35.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:35.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:35.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:15:35.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:35 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-06T13:15:36.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.251 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: pgmap v252: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 928 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.252 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: osdmap e167: 8 total, 7 up, 8 in 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:36.253 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:36 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: pgmap v252: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 928 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: osdmap e167: 8 total, 7 up, 8 in 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: pgmap v252: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 928 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: osdmap e167: 8 total, 7 up, 8 in 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:15:36.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:36 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:36.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:15:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:15:36.508+0000 7f4a17eb9700 -1 osd.5 164 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:15:37.397 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.397 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.397 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.397 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.397 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.397 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='osd.5 ' entity='osd.5' 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.398 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.399 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.400 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='osd.5 ' entity='osd.5' 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='osd.5 ' entity='osd.5' 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:37.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771] boot 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: osdmap e168: 8 total, 8 up, 8 in 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: pgmap v255: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771] boot 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: osdmap e168: 8 total, 8 up, 8 in 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: osd.5 [v2:172.21.15.186:6808/1872130771,v1:172.21.15.186:6809/1872130771] boot 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: osdmap e168: 8 total, 8 up, 8 in 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: pgmap v255: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: pgmap v255: 161 pgs: 21 active+undersized+degraded, 38 active+undersized, 102 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 75/630 objects degraded (11.905%) 2024-05-06T13:15:38.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:38.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: osdmap e169: 8 total, 8 up, 8 in 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: osdmap e169: 8 total, 8 up, 8 in 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: osdmap e169: 8 total, 8 up, 8 in 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:39.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:39.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 75/630 objects degraded (11.905%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: pgmap v257: 161 pgs: 13 peering, 10 active+undersized+degraded, 21 active+undersized, 117 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 34/630 objects degraded (5.397%) 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 75/630 objects degraded (11.905%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 75/630 objects degraded (11.905%), 21 pgs degraded (PG_DEGRADED) 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: pgmap v257: 161 pgs: 13 peering, 10 active+undersized+degraded, 21 active+undersized, 117 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 34/630 objects degraded (5.397%) 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: pgmap v257: 161 pgs: 13 peering, 10 active+undersized+degraded, 21 active+undersized, 117 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 34/630 objects degraded (5.397%) 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:40.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.239 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.240 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:41.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.312 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.313 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.314 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.315 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.316 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: pgmap v258: 161 pgs: 13 peering, 148 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.317 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.318 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: pgmap v258: 161 pgs: 13 peering, 148 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.319 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.320 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.500 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.501 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: pgmap v258: 161 pgs: 13 peering, 148 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:42.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/630 objects degraded (5.397%), 10 pgs degraded) 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/630 objects degraded (5.397%), 10 pgs degraded) 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:15:43.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.434 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:15:43.352+0000 7f9a35e30700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-05-06T13:15:43.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/630 objects degraded (5.397%), 10 pgs degraded) 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:43.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 0 op/s 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 0 op/s 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 0 op/s 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:44.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:45.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:15:44] "GET /metrics HTTP/1.1" 200 38538 "" "Prometheus/2.33.4" 2024-05-06T13:15:46.923 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:46 smithi186 ceph-mon[83629]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 0 op/s 2024-05-06T13:15:47.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:46 smithi016 ceph-mon[93192]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 0 op/s 2024-05-06T13:15:47.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:46 smithi016 ceph-mon[102669]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 0 op/s 2024-05-06T13:15:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:48 smithi016 ceph-mon[93192]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 0 op/s 2024-05-06T13:15:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:48 smithi016 ceph-mon[102669]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 0 op/s 2024-05-06T13:15:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:48 smithi186 ceph-mon[83629]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 0 op/s 2024-05-06T13:15:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:15:49.673 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:15:50.349 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:15:50.349 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 10s ago 19m - - 2024-05-06T13:15:50.349 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 6s ago 19m - - 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (9m) 10s ago 14m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (9m) 6s ago 14m 55.2M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (8m) 10s ago 12m 66.1M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (8m) 6s ago 18m 533M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (6m) 10s ago 20m 452M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (6m) 10s ago 20m 70.3M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (5m) 6s ago 19m 58.2M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (5m) 10s ago 19m 60.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (9m) 10s ago 14m 22.0M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (9m) 6s ago 14m 18.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (4m) 10s ago 18m 63.3M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (3m) 10s ago 18m 51.3M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (2m) 10s ago 17m 46.6M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (2m) 10s ago 17m 52.8M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (83s) 6s ago 16m 45.4M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (18s) 6s ago 16m 52.4M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (16m) 6s ago 16m 62.5M 4096M 17.2.0 e1d6a67b021e 85e9a26399bc 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (15m) 6s ago 15m 64.8M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (8m) 6s ago 15m 68.8M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (13m) 10s ago 13m 76.8M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (13m) 6s ago 13m 74.9M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (13m) 10s ago 13m 76.5M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (13m) 6s ago 13m 74.4M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:15:50.763 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:15:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:15:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:15:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:50.763 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 6 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 11 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:15:50.764 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:15:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:15:51.111 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "11/23 daemons upgraded", 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:15:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:15:51.112 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[93192]: from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[93192]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3757351449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[102669]: from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[102669]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-05-06T13:15:51.113 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:50 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3757351449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:15:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:50 smithi186 ceph-mon[83629]: from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:50 smithi186 ceph-mon[83629]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-05-06T13:15:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:50 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3757351449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:15:51.521 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:15:52.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:51 smithi016 ceph-mon[93192]: from='client.44625 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:52.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:51 smithi016 ceph-mon[93192]: from='client.64528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:52.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:51 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1540360565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:15:52.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:51 smithi016 ceph-mon[102669]: from='client.44625 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:52.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:51 smithi016 ceph-mon[102669]: from='client.64528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:52.138 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:51 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1540360565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:15:52.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:51 smithi186 ceph-mon[83629]: from='client.44625 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:52.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:51 smithi186 ceph-mon[83629]: from='client.64528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:52.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:51 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1540360565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:15:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:52 smithi016 ceph-mon[93192]: from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:52 smithi016 ceph-mon[93192]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:15:53.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:52 smithi016 ceph-mon[102669]: from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:53.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:52 smithi016 ceph-mon[102669]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:15:53.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:52 smithi186 ceph-mon[83629]: from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:15:53.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:52 smithi186 ceph-mon[83629]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:15:54.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:54.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:54 smithi016 ceph-mon[93192]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:54.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:54.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:54 smithi016 ceph-mon[102669]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:15:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:54 smithi186 ceph-mon[83629]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:15:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:15:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:15:54] "GET /metrics HTTP/1.1" 200 38536 "" "Prometheus/2.33.4" 2024-05-06T13:15:57.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:56 smithi016 ceph-mon[93192]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:57.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:56 smithi016 ceph-mon[102669]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:56 smithi186 ceph-mon[83629]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:59.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:58 smithi186 ceph-mon[83629]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:59.084 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:59.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:58 smithi016 ceph-mon[93192]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:59.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:15:59.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:58 smithi016 ceph-mon[102669]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:15:59.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[93192]: Upgrade: osd.6 is safe to restart 2024-05-06T13:16:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[102669]: Upgrade: osd.6 is safe to restart 2024-05-06T13:16:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:15:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:59 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:59 smithi186 ceph-mon[83629]: Upgrade: osd.6 is safe to restart 2024-05-06T13:16:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:15:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.900 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:00 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:00.900 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:00 smithi186 ceph-mon[83629]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:16:00.900 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:00.900 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:16:00.900 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:01.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:01.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[93192]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:16:01.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:01.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:16:01.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:01.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:01.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[102669]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:16:01.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:01.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:16:01.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:02.099 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:01 smithi186 ceph-mon[83629]: Upgrade: Updating osd.6 2024-05-06T13:16:02.100 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:01 smithi186 ceph-mon[83629]: Deploying daemon osd.6 on smithi186 2024-05-06T13:16:02.100 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:01 smithi186 ceph-mon[83629]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:02.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:01 smithi016 ceph-mon[93192]: Upgrade: Updating osd.6 2024-05-06T13:16:02.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:01 smithi016 ceph-mon[93192]: Deploying daemon osd.6 on smithi186 2024-05-06T13:16:02.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:01 smithi016 ceph-mon[93192]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:02.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:01 smithi016 ceph-mon[102669]: Upgrade: Updating osd.6 2024-05-06T13:16:02.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:01 smithi016 ceph-mon[102669]: Deploying daemon osd.6 on smithi186 2024-05-06T13:16:02.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:01 smithi016 ceph-mon[102669]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:03.127 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:03.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:03.220 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:03.484 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:03 smithi186 systemd[1]: Stopping Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:16:03.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[33852]: 2024-05-06T13:16:03.482+0000 7f3836738700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:16:03.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[33852]: 2024-05-06T13:16:03.482+0000 7f3836738700 -1 osd.6 169 *** Got signal Terminated *** 2024-05-06T13:16:03.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:03 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[33852]: 2024-05-06T13:16:03.482+0000 7f3836738700 -1 osd.6 169 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:16:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:03 smithi016 ceph-mon[93192]: osd.6 marked itself down and dead 2024-05-06T13:16:04.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:03 smithi016 ceph-mon[93192]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:16:04.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:03 smithi016 ceph-mon[102669]: osd.6 marked itself down and dead 2024-05-06T13:16:04.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:03 smithi016 ceph-mon[102669]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:16:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:03 smithi186 ceph-mon[83629]: osd.6 marked itself down and dead 2024-05-06T13:16:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:03 smithi186 ceph-mon[83629]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:16:04.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:16:04] "GET /metrics HTTP/1.1" 200 38538 "" "Prometheus/2.33.4" 2024-05-06T13:16:04.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:04 smithi186 podman[130008]: 2024-05-06 13:16:04.351719895 +0000 UTC m=+0.974759161 container died 85e9a26399bc306ca66dc201ad47fde2b97a092318c363fcdf4040ffc7e9b34c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, name=centos-stream, RELEASE=HEAD, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., architecture=x86_64, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, maintainer=Guillaume Abrioux , release=754, vcs-type=git) 2024-05-06T13:16:05.092 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:04 smithi186 podman[130008]: 2024-05-06 13:16:04.866163225 +0000 UTC m=+1.489202490 container cleanup 85e9a26399bc306ca66dc201ad47fde2b97a092318c363fcdf4040ffc7e9b34c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, RELEASE=HEAD, distribution-scope=public, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, ceph=True, io.buildah.version=1.19.8, name=centos-stream, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64) 2024-05-06T13:16:05.092 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:04 smithi186 bash[130008]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6 2024-05-06T13:16:05.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:04 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:16:05.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:04 smithi186 ceph-mon[83629]: osdmap e170: 8 total, 7 up, 8 in 2024-05-06T13:16:05.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.218 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:16:05.218 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[93192]: osdmap e170: 8 total, 7 up, 8 in 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[102669]: osdmap e170: 8 total, 7 up, 8 in 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.219 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:05.512 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:05 smithi186 podman[130049]: 2024-05-06 13:16:05.092707769 +0000 UTC m=+0.737615186 container remove 85e9a26399bc306ca66dc201ad47fde2b97a092318c363fcdf4040ffc7e9b34c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, io.openshift.expose-services=, architecture=x86_64, GIT_BRANCH=HEAD, name=centos-stream, distribution-scope=public, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, vcs-type=git, io.openshift.tags=base centos centos-stream, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-06T13:16:05.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:05 smithi186 podman[130139]: 2024-05-06 13:16:05.417038502 +0000 UTC m=+0.019659196 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:16:05.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:05 smithi186 podman[130139]: 2024-05-06 13:16:05.527262095 +0000 UTC m=+0.129882770 container create 41dd161fd59fabaf53b1e71da51e544d63d94906800b6352560ca284589ad656 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-06T13:16:06.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:05 smithi186 ceph-mon[83629]: osdmap e171: 8 total, 7 up, 8 in 2024-05-06T13:16:06.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:05 smithi186 ceph-mon[83629]: pgmap v272: 161 pgs: 3 peering, 11 stale+active+clean, 147 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:06.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:05 smithi016 ceph-mon[93192]: osdmap e171: 8 total, 7 up, 8 in 2024-05-06T13:16:06.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:05 smithi016 ceph-mon[93192]: pgmap v272: 161 pgs: 3 peering, 11 stale+active+clean, 147 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:06.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:05 smithi016 ceph-mon[102669]: osdmap e171: 8 total, 7 up, 8 in 2024-05-06T13:16:06.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:05 smithi016 ceph-mon[102669]: pgmap v272: 161 pgs: 3 peering, 11 stale+active+clean, 147 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:06.675 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:06 smithi186 podman[130139]: 2024-05-06 13:16:06.37512537 +0000 UTC m=+0.977746045 container init 41dd161fd59fabaf53b1e71da51e544d63d94906800b6352560ca284589ad656 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-05-06T13:16:06.676 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:06 smithi186 podman[130139]: 2024-05-06 13:16:06.378396041 +0000 UTC m=+0.981016716 container start 41dd161fd59fabaf53b1e71da51e544d63d94906800b6352560ca284589ad656 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-06T13:16:06.676 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:06 smithi186 podman[130139]: 2024-05-06 13:16:06.458674322 +0000 UTC m=+1.061295015 container attach 41dd161fd59fabaf53b1e71da51e544d63d94906800b6352560ca284589ad656 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-06T13:16:07.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:06 smithi186 ceph-mon[83629]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-06T13:16:07.265 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:07 smithi186 podman[130139]: 2024-05-06 13:16:07.005700649 +0000 UTC m=+1.608321317 container died 41dd161fd59fabaf53b1e71da51e544d63d94906800b6352560ca284589ad656 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-06T13:16:07.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:06 smithi016 ceph-mon[93192]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-06T13:16:07.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:06 smithi016 ceph-mon[102669]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-06T13:16:07.954 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:07 smithi186 podman[130200]: 2024-05-06 13:16:07.615693108 +0000 UTC m=+0.934067849 container remove 41dd161fd59fabaf53b1e71da51e544d63d94906800b6352560ca284589ad656 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-05-06T13:16:07.954 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:07 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6.service: Deactivated successfully. 2024-05-06T13:16:07.954 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:07 smithi186 systemd[1]: Stopped Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:16:07.954 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:07 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6.service: Consumed 10.220s CPU time. 2024-05-06T13:16:07.954 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:07 smithi186 systemd[1]: Starting Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:16:08.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:07 smithi186 ceph-mon[83629]: pgmap v273: 161 pgs: 10 active+undersized+degraded, 3 peering, 3 stale+active+clean, 14 active+undersized, 131 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 40/630 objects degraded (6.349%) 2024-05-06T13:16:08.265 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 podman[130304]: 2024-05-06 13:16:07.967577867 +0000 UTC m=+0.018521278 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:16:08.265 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 podman[130304]: 2024-05-06 13:16:08.083476896 +0000 UTC m=+0.134420285 container create 92deb5236203dc35a5df280bf1da36d4c11ba26c73206fa88828550215594ce0 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-06T13:16:08.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:07 smithi016 ceph-mon[93192]: pgmap v273: 161 pgs: 10 active+undersized+degraded, 3 peering, 3 stale+active+clean, 14 active+undersized, 131 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 40/630 objects degraded (6.349%) 2024-05-06T13:16:08.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:07 smithi016 ceph-mon[102669]: pgmap v273: 161 pgs: 10 active+undersized+degraded, 3 peering, 3 stale+active+clean, 14 active+undersized, 131 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 40/630 objects degraded (6.349%) 2024-05-06T13:16:08.730 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 podman[130304]: 2024-05-06 13:16:08.283575026 +0000 UTC m=+0.334518433 container init 92deb5236203dc35a5df280bf1da36d4c11ba26c73206fa88828550215594ce0 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:16:08.730 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 podman[130304]: 2024-05-06 13:16:08.286973385 +0000 UTC m=+0.337916783 container start 92deb5236203dc35a5df280bf1da36d4c11ba26c73206fa88828550215594ce0 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-06T13:16:08.730 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 podman[130304]: 2024-05-06 13:16:08.386319328 +0000 UTC m=+0.437262731 container attach 92deb5236203dc35a5df280bf1da36d4c11ba26c73206fa88828550215594ce0 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, ceph=True) 2024-05-06T13:16:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:08 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 40/630 objects degraded (6.349%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:09.015 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 bash[130304]: --> ceph-volume raw activate successful for osd ID: 6 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T13:16:09.016 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-05-06T13:16:09.017 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:09.017 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[130319]: --> ceph-volume raw activate successful for osd ID: 6 2024-05-06T13:16:09.017 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:08 smithi186 podman[130304]: 2024-05-06 13:16:08.756590383 +0000 UTC m=+0.807533782 container died 92deb5236203dc35a5df280bf1da36d4c11ba26c73206fa88828550215594ce0 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-06T13:16:09.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:08 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 40/630 objects degraded (6.349%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:09.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:08 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 40/630 objects degraded (6.349%), 10 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:09.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:09 smithi186 podman[130447]: 2024-05-06 13:16:09.315135761 +0000 UTC m=+0.549485003 container remove 92deb5236203dc35a5df280bf1da36d4c11ba26c73206fa88828550215594ce0 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-06T13:16:09.798 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:09 smithi186 podman[130509]: 2024-05-06 13:16:09.433899917 +0000 UTC m=+0.017656922 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:16:09.799 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:09 smithi186 podman[130509]: 2024-05-06 13:16:09.67454363 +0000 UTC m=+0.258300635 container create 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430) 2024-05-06T13:16:10.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:09 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:10.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:09 smithi186 ceph-mon[83629]: pgmap v274: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:10.204 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:09 smithi186 podman[130509]: 2024-05-06 13:16:09.910476634 +0000 UTC m=+0.494233638 container init 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-06T13:16:10.204 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:09 smithi186 podman[130509]: 2024-05-06 13:16:09.914126216 +0000 UTC m=+0.497883222 container start 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:16:10.204 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:09 smithi186 ceph-osd[130528]: -- 172.21.15.186:0/3391254733 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562931aa7680 con 0x562931a70c00 2024-05-06T13:16:10.205 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:10 smithi186 bash[130509]: 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a 2024-05-06T13:16:10.205 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:10 smithi186 systemd[1]: Started Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:16:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:09 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:10.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:09 smithi016 ceph-mon[93192]: pgmap v274: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:10.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:09 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:10.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:09 smithi016 ceph-mon[102669]: pgmap v274: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:10.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:10.450+0000 7f2fa93347c0 -1 Falling back to public interface 2024-05-06T13:16:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-06T13:16:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:11.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-06T13:16:11.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-06T13:16:11.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:11.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: pgmap v275: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:11 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.391 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.392 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.393 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: pgmap v275: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:12.394 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.395 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: pgmap v275: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:12.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:11 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.093 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.094 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.369 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:13.168+0000 7f2fa93347c0 -1 osd.6 0 read_superblock omap replica is missing. 2024-05-06T13:16:13.369 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:13 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:13.197+0000 7f2fa93347c0 -1 osd.6 169 log_to_monitors true 2024-05-06T13:16:13.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:13.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:13.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:13.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:13.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:13.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.218 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.219 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.220 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: pgmap v276: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.221 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.222 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: pgmap v276: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: pgmap v276: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:14.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:14.968 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:16:14] "GET /metrics HTTP/1.1" 200 38538 "" "Prometheus/2.33.4" 2024-05-06T13:16:14.969 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:14.596+0000 7f2f96783700 -1 osd.6 169 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:16:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: osdmap e172: 8 total, 7 up, 8 in 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 18 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: osdmap e172: 8 total, 7 up, 8 in 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 18 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: osdmap e172: 8 total, 7 up, 8 in 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:15.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 18 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' 2024-05-06T13:16:15.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:15.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:16:16.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317] boot 2024-05-06T13:16:16.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: osdmap e173: 8 total, 8 up, 8 in 2024-05-06T13:16:16.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:16:16.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: pgmap v279: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317] boot 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: osdmap e173: 8 total, 8 up, 8 in 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: pgmap v279: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.435 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: osd.6 [v2:172.21.15.186:6816/1803492317,v1:172.21.15.186:6817/1803492317] boot 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: osdmap e173: 8 total, 8 up, 8 in 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.436 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:16.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:16.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: pgmap v279: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:16.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:16.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:16.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:16.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:16.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: osdmap e174: 8 total, 8 up, 8 in 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: osdmap e174: 8 total, 8 up, 8 in 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: osdmap e174: 8 total, 8 up, 8 in 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:17.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:17.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:17.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:17.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:17.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: pgmap v281: 161 pgs: 16 peering, 13 active+undersized+degraded, 24 active+undersized, 108 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:18.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: pgmap v281: 161 pgs: 16 peering, 13 active+undersized+degraded, 24 active+undersized, 108 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:18.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: pgmap v281: 161 pgs: 16 peering, 13 active+undersized+degraded, 24 active+undersized, 108 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 53/630 objects degraded (8.413%) 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:18.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:19.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:19.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:19.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:19.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 13 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 13 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: pgmap v282: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-06T13:16:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: pgmap v282: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 53/630 objects degraded (8.413%), 13 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: pgmap v282: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:20.247 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 53/630 objects degraded (8.413%), 13 pgs degraded) 2024-05-06T13:16:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.434 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.434 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 53/630 objects degraded (8.413%), 13 pgs degraded) 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.435 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.436 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.437 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 53/630 objects degraded (8.413%), 13 pgs degraded) 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.438 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:21.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:21.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:21.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:21.439 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:21.890 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:16:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 401 B/s rd, 0 op/s 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 401 B/s rd, 0 op/s 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 401 B/s rd, 0 op/s 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:16:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 2s ago 20m - - 2024-05-06T13:16:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 18s ago 19m - - 2024-05-06T13:16:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (10m) 2s ago 14m 23.2M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:16:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (9m) 18s ago 14m 54.0M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:16:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (8m) 2s ago 13m 66.1M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (9m) 18s ago 19m 534M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (7m) 2s ago 21m 452M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (7m) 2s ago 21m 72.2M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (6m) 18s ago 19m 54.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (6m) 2s ago 19m 61.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (10m) 2s ago 15m 19.0M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (9m) 18s ago 15m 18.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (4m) 2s ago 19m 64.8M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (4m) 2s ago 18m 53.2M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (3m) 2s ago 18m 47.0M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (2m) 2s ago 17m 54.3M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (116s) 18s ago 17m 45.5M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (51s) 18s ago 17m 52.7M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 starting - - - 4096M 2024-05-06T13:16:22.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (16m) 18s ago 16m 64.8M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:16:22.600 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (8m) 18s ago 15m 68.8M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:16:22.600 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (14m) 2s ago 13m 77.0M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:16:22.600 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (13m) 18s ago 13m 74.9M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:16:22.600 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (13m) 2s ago 13m 76.7M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:16:22.600 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (13m) 18s ago 13m 74.5M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:16:23.028 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 7 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:23.029 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 12 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:16:23.030 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:16:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='client.64558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='client.64564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='client.44673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.205 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.206 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.381 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:16:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:16:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:16:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:16:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "11/23 daemons upgraded", 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:16:23.382 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:16:23.382 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='client.64558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.383 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='client.64564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.384 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='client.64558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.385 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.386 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='client.64564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.387 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='client.44673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.388 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.389 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.390 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='client.44673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.391 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:23.392 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:23.803 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:16:24.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3069713357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.164 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='client.44685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.165 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3069713357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.166 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='client.44685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:24.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.168 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s 2024-05-06T13:16:24.169 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/162325049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/162325049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.261 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3069713357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.262 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='client.44685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.263 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/162325049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.820 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:16:24] "GET /metrics HTTP/1.1" 200 38398 "" "Prometheus/2.33.4" 2024-05-06T13:16:24.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.983 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:24.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:24.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:24.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:24.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:24.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:24.984 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[93192]: Upgrade: osd.6 is safe to restart 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:24 smithi016 ceph-mon[102669]: Upgrade: osd.6 is safe to restart 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-05-06T13:16:25.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:24 smithi186 ceph-mon[83629]: Upgrade: osd.6 is safe to restart 2024-05-06T13:16:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:26 smithi186 ceph-mon[83629]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.907 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[93192]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:26 smithi016 ceph-mon[102669]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s 2024-05-06T13:16:28.014 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:16:28.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:28.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:16:28.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-06T13:16:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[93192]: Upgrade: Updating osd.6 2024-05-06T13:16:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[93192]: Deploying daemon osd.6 on smithi186 2024-05-06T13:16:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[93192]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2024-05-06T13:16:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[102669]: Upgrade: Updating osd.6 2024-05-06T13:16:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[102669]: Deploying daemon osd.6 on smithi186 2024-05-06T13:16:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[102669]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2024-05-06T13:16:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:28 smithi186 ceph-mon[83629]: Upgrade: Updating osd.6 2024-05-06T13:16:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:28 smithi186 ceph-mon[83629]: Deploying daemon osd.6 on smithi186 2024-05-06T13:16:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:28 smithi186 ceph-mon[83629]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 732 B/s rd, 0 op/s 2024-05-06T13:16:29.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:31.107 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:31.107 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:30 smithi186 ceph-mon[83629]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:31.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:31.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:30 smithi016 ceph-mon[93192]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:31.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:31.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:30 smithi016 ceph-mon[102669]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:31.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:31 smithi186 systemd[1]: Stopping Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:16:31.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:31.678+0000 7f2f9f99a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:16:31.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:31.678+0000 7f2f9f99a700 -1 osd.6 174 *** Got signal Terminated *** 2024-05-06T13:16:31.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[130524]: 2024-05-06T13:16:31.678+0000 7f2f9f99a700 -1 osd.6 174 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:16:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:31 smithi016 ceph-mon[93192]: osd.6 marked itself down and dead 2024-05-06T13:16:32.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:31 smithi016 ceph-mon[93192]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:32.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:31 smithi016 ceph-mon[102669]: osd.6 marked itself down and dead 2024-05-06T13:16:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:31 smithi016 ceph-mon[102669]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:32.229 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:31 smithi186 ceph-mon[83629]: osd.6 marked itself down and dead 2024-05-06T13:16:32.229 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:31 smithi186 ceph-mon[83629]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:32.495 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:32 smithi186 podman[136367]: 2024-05-06 13:16:32.230417393 +0000 UTC m=+0.637123367 container died 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-06T13:16:32.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:32 smithi186 podman[136367]: 2024-05-06 13:16:32.586761576 +0000 UTC m=+0.993467559 container cleanup 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, ceph=True) 2024-05-06T13:16:32.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:32 smithi186 bash[136367]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6 2024-05-06T13:16:32.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:32 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:16:32.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:32 smithi016 ceph-mon[93192]: osdmap e175: 8 total, 7 up, 8 in 2024-05-06T13:16:32.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:32 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:16:32.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:32 smithi016 ceph-mon[102669]: osdmap e175: 8 total, 7 up, 8 in 2024-05-06T13:16:33.207 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:32 smithi186 podman[136384]: 2024-05-06 13:16:32.888273009 +0000 UTC m=+0.660388299 container remove 2e22e84a02b0532ffc211635647aa4b4bd664a8cbc51f0d1d4e6ead9161d098a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953) 2024-05-06T13:16:33.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:32 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:16:33.207 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:32 smithi186 ceph-mon[83629]: osdmap e175: 8 total, 7 up, 8 in 2024-05-06T13:16:33.474 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:33 smithi186 podman[136477]: 2024-05-06 13:16:33.111109388 +0000 UTC m=+0.018153839 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:16:33.474 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:33 smithi186 podman[136477]: 2024-05-06 13:16:33.214272788 +0000 UTC m=+0.121317281 container create 8a15308eedf945af9b4662d1b6b0ef96095077b4d87883328c5e7fc2471f815a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-05-06T13:16:33.474 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:33 smithi186 podman[136477]: 2024-05-06 13:16:33.400187638 +0000 UTC m=+0.307232104 container init 8a15308eedf945af9b4662d1b6b0ef96095077b4d87883328c5e7fc2471f815a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux ) 2024-05-06T13:16:33.475 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:33 smithi186 podman[136477]: 2024-05-06 13:16:33.403280226 +0000 UTC m=+0.310324680 container start 8a15308eedf945af9b4662d1b6b0ef96095077b4d87883328c5e7fc2471f815a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-06T13:16:33.475 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:33 smithi186 podman[136477]: 2024-05-06 13:16:33.475070737 +0000 UTC m=+0.382115197 container attach 8a15308eedf945af9b4662d1b6b0ef96095077b4d87883328c5e7fc2471f815a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:16:33.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:33 smithi186 podman[136477]: 2024-05-06 13:16:33.700111337 +0000 UTC m=+0.607155782 container died 8a15308eedf945af9b4662d1b6b0ef96095077b4d87883328c5e7fc2471f815a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-06T13:16:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[93192]: osdmap e176: 8 total, 7 up, 8 in 2024-05-06T13:16:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[93192]: pgmap v291: 161 pgs: 4 active+undersized+degraded, 11 stale+active+clean, 12 active+undersized, 134 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 20/630 objects degraded (3.175%) 2024-05-06T13:16:34.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[102669]: osdmap e176: 8 total, 7 up, 8 in 2024-05-06T13:16:34.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:34.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:34.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:33 smithi016 ceph-mon[102669]: pgmap v291: 161 pgs: 4 active+undersized+degraded, 11 stale+active+clean, 12 active+undersized, 134 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 20/630 objects degraded (3.175%) 2024-05-06T13:16:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:33 smithi186 ceph-mon[83629]: osdmap e176: 8 total, 7 up, 8 in 2024-05-06T13:16:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:33 smithi186 ceph-mon[83629]: pgmap v291: 161 pgs: 4 active+undersized+degraded, 11 stale+active+clean, 12 active+undersized, 134 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 20/630 objects degraded (3.175%) 2024-05-06T13:16:34.557 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 podman[136503]: 2024-05-06 13:16:34.287424024 +0000 UTC m=+0.581808791 container remove 8a15308eedf945af9b4662d1b6b0ef96095077b4d87883328c5e7fc2471f815a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-06T13:16:34.557 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6.service: Deactivated successfully. 2024-05-06T13:16:34.557 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 systemd[1]: Stopped Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:16:34.557 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6.service: Consumed 1.973s CPU time. 2024-05-06T13:16:34.558 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 systemd[1]: Starting Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:16:34.861 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:16:34] "GET /metrics HTTP/1.1" 200 38545 "" "Prometheus/2.33.4" 2024-05-06T13:16:34.861 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 podman[136612]: 2024-05-06 13:16:34.664292518 +0000 UTC m=+0.019299359 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:16:34.861 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:34 smithi186 podman[136612]: 2024-05-06 13:16:34.780278971 +0000 UTC m=+0.135285800 container create a3517b2fce17638fe5663c7bffe10a9119bf570e8cba2286c7701cc8cdd7d3d7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-06T13:16:35.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:34 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 20/630 objects degraded (3.175%), 4 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:35.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:34 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 20/630 objects degraded (3.175%), 4 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:35.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:34 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 20/630 objects degraded (3.175%), 4 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:35.266 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 podman[136612]: 2024-05-06 13:16:35.02503351 +0000 UTC m=+0.380040340 container init a3517b2fce17638fe5663c7bffe10a9119bf570e8cba2286c7701cc8cdd7d3d7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-06T13:16:35.266 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 podman[136612]: 2024-05-06 13:16:35.028525912 +0000 UTC m=+0.383532751 container start a3517b2fce17638fe5663c7bffe10a9119bf570e8cba2286c7701cc8cdd7d3d7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-05-06T13:16:35.266 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 podman[136612]: 2024-05-06 13:16:35.10683625 +0000 UTC m=+0.461843080 container attach a3517b2fce17638fe5663c7bffe10a9119bf570e8cba2286c7701cc8cdd7d3d7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-06T13:16:35.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 bash[136612]: --> ceph-volume raw activate successful for osd ID: 6 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-06T13:16:35.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-05-06T13:16:35.767 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T13:16:35.767 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate[136634]: --> ceph-volume raw activate successful for osd ID: 6 2024-05-06T13:16:35.767 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:35 smithi186 podman[136612]: 2024-05-06 13:16:35.504875806 +0000 UTC m=+0.859882639 container died a3517b2fce17638fe5663c7bffe10a9119bf570e8cba2286c7701cc8cdd7d3d7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, io.buildah.version=1.33.5) 2024-05-06T13:16:36.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:35 smithi186 ceph-mon[83629]: pgmap v292: 161 pgs: 8 active+undersized+degraded, 8 stale+active+clean, 21 active+undersized, 124 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 37/630 objects degraded (5.873%) 2024-05-06T13:16:36.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:35 smithi016 ceph-mon[93192]: pgmap v292: 161 pgs: 8 active+undersized+degraded, 8 stale+active+clean, 21 active+undersized, 124 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 37/630 objects degraded (5.873%) 2024-05-06T13:16:36.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:35 smithi016 ceph-mon[102669]: pgmap v292: 161 pgs: 8 active+undersized+degraded, 8 stale+active+clean, 21 active+undersized, 124 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 37/630 objects degraded (5.873%) 2024-05-06T13:16:36.476 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 podman[136765]: 2024-05-06 13:16:36.161796384 +0000 UTC m=+0.648145851 container remove a3517b2fce17638fe5663c7bffe10a9119bf570e8cba2286c7701cc8cdd7d3d7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:16:36.476 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 podman[136827]: 2024-05-06 13:16:36.37113432 +0000 UTC m=+0.109266449 container create ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:16:36.477 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 podman[136827]: 2024-05-06 13:16:36.280193264 +0000 UTC m=+0.018325394 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:16:36.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 podman[136827]: 2024-05-06 13:16:36.590863629 +0000 UTC m=+0.328995760 container init ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-06T13:16:36.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 podman[136827]: 2024-05-06 13:16:36.593892821 +0000 UTC m=+0.332024954 container start ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-70ce953, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-06T13:16:36.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 ceph-osd[136846]: -- 172.21.15.186:0/2628670098 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617e1d17680 con 0x5617e1ce1000 2024-05-06T13:16:36.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 bash[136827]: ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 2024-05-06T13:16:36.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:36 smithi186 systemd[1]: Started Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:16:37.176 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:16:37.134+0000 7f5eb58767c0 -1 Falling back to public interface 2024-05-06T13:16:37.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:37.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.928 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.929 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:37.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:37.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:37.931 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: pgmap v293: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.022 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.023 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.024 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.024 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.024 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.024 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:38 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: pgmap v293: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: pgmap v293: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 77/630 objects degraded (12.222%) 2024-05-06T13:16:39.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:38 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 18 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:39.843 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:39.844 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:39.844 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:39 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.112 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:16:39.890+0000 7f5eb58767c0 -1 osd.6 174 log_to_monitors true 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 18 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 77/630 objects degraded (12.222%), 18 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:39 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.926 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:16:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:16:40.857+0000 7f5ea2cc5700 -1 osd.6 174 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:40.927 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: pgmap v294: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.928 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.929 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.930 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:40.931 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:40 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: pgmap v294: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: pgmap v294: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:41.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:41.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:41.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:40 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: osdmap e177: 8 total, 7 up, 8 in 2024-05-06T13:16:42.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: osdmap e177: 8 total, 7 up, 8 in 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: osdmap e177: 8 total, 7 up, 8 in 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:42.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:42.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: pgmap v296: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:43.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824] boot 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: osdmap e178: 8 total, 8 up, 8 in 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.020 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.021 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:42 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: pgmap v296: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824] boot 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: osdmap e178: 8 total, 8 up, 8 in 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: pgmap v296: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 0 op/s; 77/630 objects degraded (12.222%) 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: osd.6 [v2:172.21.15.186:6816/4258100824,v1:172.21.15.186:6817/4258100824] boot 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: osdmap e178: 8 total, 8 up, 8 in 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:42 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: osdmap e179: 8 total, 8 up, 8 in 2024-05-06T13:16:43.979 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.980 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.981 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:43.982 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:43.983 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: osdmap e179: 8 total, 8 up, 8 in 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: osdmap e179: 8 total, 8 up, 8 in 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.986 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:16:44] "GET /metrics HTTP/1.1" 200 38545 "" "Prometheus/2.33.4" 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:44.987 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: pgmap v299: 161 pgs: 14 active+undersized+degraded, 25 active+undersized, 122 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 57/630 objects degraded (9.048%) 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.988 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.989 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.990 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:44.991 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.035 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: pgmap v299: 161 pgs: 14 active+undersized+degraded, 25 active+undersized, 122 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 57/630 objects degraded (9.048%) 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.036 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.037 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: pgmap v299: 161 pgs: 14 active+undersized+degraded, 25 active+undersized, 122 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 57/630 objects degraded (9.048%) 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.038 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.039 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.042 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.043 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.045 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.046 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.047 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 57/630 objects degraded (9.048%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.839 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.840 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.841 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:45.842 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:45 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.055 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 57/630 objects degraded (9.048%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.056 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.057 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 57/630 objects degraded (9.048%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:16:46.058 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.059 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.062 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.064 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:46.065 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:45 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:46.152 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:16:46.052+0000 7f9a35e30700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-05-06T13:16:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: pgmap v300: 161 pgs: 11 active+undersized+degraded, 18 active+undersized, 132 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 42/630 objects degraded (6.667%) 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:46 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:16:47.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.161 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: pgmap v300: 161 pgs: 11 active+undersized+degraded, 18 active+undersized, 132 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 42/630 objects degraded (6.667%) 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.162 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.163 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: pgmap v300: 161 pgs: 11 active+undersized+degraded, 18 active+undersized, 132 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 42/630 objects degraded (6.667%) 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:47.164 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:47.165 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:46 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:16:47.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:47 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:16:47.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:47 smithi186 ceph-mon[83629]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-05-06T13:16:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:47 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:16:48.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:47 smithi016 ceph-mon[93192]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-05-06T13:16:48.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:47 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:16:48.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:47 smithi016 ceph-mon[102669]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-05-06T13:16:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:48 smithi186 ceph-mon[83629]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 589 B/s rd, 0 op/s 2024-05-06T13:16:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[93192]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 589 B/s rd, 0 op/s 2024-05-06T13:16:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[102669]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 589 B/s rd, 0 op/s 2024-05-06T13:16:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:16:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/630 objects degraded (6.667%), 11 pgs degraded) 2024-05-06T13:16:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:16:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/630 objects degraded (6.667%), 11 pgs degraded) 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:49 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/630 objects degraded (6.667%), 11 pgs degraded) 2024-05-06T13:16:50.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:49 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:16:50.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:50.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:51.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:50 smithi016 ceph-mon[93192]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:51.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:50 smithi016 ceph-mon[102669]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:16:51.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:50 smithi186 ceph-mon[83629]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:16:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:52 smithi016 ceph-mon[93192]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 926 B/s rd, 0 op/s 2024-05-06T13:16:53.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:52 smithi016 ceph-mon[102669]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 926 B/s rd, 0 op/s 2024-05-06T13:16:53.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:52 smithi186 ceph-mon[83629]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 926 B/s rd, 0 op/s 2024-05-06T13:16:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:16:54.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:54.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:54 smithi016 ceph-mon[93192]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:16:54.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:54.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:54 smithi016 ceph-mon[102669]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:16:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:16:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:54 smithi186 ceph-mon[83629]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 14s ago 20m - - 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 5s ago 20m - - 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (10m) 14s ago 15m 23.3M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (10m) 5s ago 15m 53.4M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (9m) 14s ago 14m 66.1M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (9m) 5s ago 19m 539M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (8m) 14s ago 21m 453M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:16:54.860 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (7m) 14s ago 21m 73.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (6m) 5s ago 20m 58.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (6m) 14s ago 20m 61.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (10m) 14s ago 15m 18.8M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (10m) 5s ago 15m 18.1M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (5m) 14s ago 19m 65.5M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (4m) 14s ago 19m 54.1M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (3m) 14s ago 18m 48.2M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (3m) 14s ago 18m 55.3M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (2m) 5s ago 18m 48.2M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (83s) 5s ago 17m 54.6M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (18s) 5s ago 17m 40.9M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ce2aaac07e20 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (16m) 5s ago 16m 65.7M 4096M 17.2.0 e1d6a67b021e 89fd98d90782 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (9m) 5s ago 16m 68.9M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (14m) 14s ago 14m 77.1M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (14m) 5s ago 14m 75.2M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:16:54.861 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (14m) 14s ago 14m 76.8M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:16:54.862 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (14m) 5s ago 14m 74.8M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:16:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:16:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:16:54] "GET /metrics HTTP/1.1" 200 38545 "" "Prometheus/2.33.4" 2024-05-06T13:16:55.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:55 smithi016 ceph-mon[93192]: from='client.44697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:55.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:55 smithi016 ceph-mon[93192]: from='client.64603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:55.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:55 smithi016 ceph-mon[102669]: from='client.44697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:55.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:55 smithi016 ceph-mon[102669]: from='client.64603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:55.273 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:16:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:16:55.273 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 7 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-05-06T13:16:55.274 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 12 2024-05-06T13:16:55.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:16:55.275 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:16:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:55 smithi186 ceph-mon[83629]: from='client.44697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:55 smithi186 ceph-mon[83629]: from='client.64603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:55.620 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "12/23 daemons upgraded", 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:16:55.621 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:16:56.035 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:16:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:56 smithi186 ceph-mon[83629]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:56 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3173753773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:56 smithi186 ceph-mon[83629]: from='client.44721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:56 smithi186 ceph-mon[83629]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:56.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:56 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3002598693' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:16:56.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[93192]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:56.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3173753773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:56.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[93192]: from='client.44721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:56.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[93192]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:56.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3002598693' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:16:56.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[102669]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:56.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3173753773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:16:56.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[102669]: from='client.44721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:16:56.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[102669]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:56.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:56 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3002598693' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:16:58.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:57 smithi016 ceph-mon[93192]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:58.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:57 smithi016 ceph-mon[102669]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:16:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:57 smithi186 ceph-mon[83629]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:59 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:16:59 smithi016 ceph-mon[93192]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:59 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:00.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:16:59 smithi016 ceph-mon[102669]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:59 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:16:59 smithi186 ceph-mon[83629]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:01.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.328 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:17:01.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.329 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:17:01.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:01.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:17:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:02 smithi186 ceph-mon[83629]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:17:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:02 smithi186 ceph-mon[83629]: Upgrade: osd.7 is safe to restart 2024-05-06T13:17:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:02 smithi186 ceph-mon[83629]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:02.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:02 smithi016 ceph-mon[93192]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:17:02.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:02 smithi016 ceph-mon[93192]: Upgrade: osd.7 is safe to restart 2024-05-06T13:17:02.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:02 smithi016 ceph-mon[93192]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:02.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:02 smithi016 ceph-mon[102669]: from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-05-06T13:17:02.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:02 smithi016 ceph-mon[102669]: Upgrade: osd.7 is safe to restart 2024-05-06T13:17:02.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:02 smithi016 ceph-mon[102669]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: Upgrade: Updating osd.7 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: Deploying daemon osd.7 on smithi186 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: Upgrade: Updating osd.7 2024-05-06T13:17:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T13:17:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: Deploying daemon osd.7 on smithi186 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: Upgrade: Updating osd.7 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: Deploying daemon osd.7 on smithi186 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:03.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:04.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:04 smithi186 ceph-mon[83629]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:04.766 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:17:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:17:04] "GET /metrics HTTP/1.1" 200 38545 "" "Prometheus/2.33.4" 2024-05-06T13:17:04.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:04 smithi016 ceph-mon[93192]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:04.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:04 smithi016 ceph-mon[102669]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:06.154 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:05 smithi016 ceph-mon[93192]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:06.154 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:05 smithi016 ceph-mon[102669]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:06.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:05 smithi186 ceph-mon[83629]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:06.244 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:05 smithi186 systemd[1]: Stopping Ceph osd.7 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:17:06.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[36800]: 2024-05-06T13:17:06.267+0000 7f544bffd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:17:06.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[36800]: 2024-05-06T13:17:06.267+0000 7f544bffd700 -1 osd.7 179 *** Got signal Terminated *** 2024-05-06T13:17:06.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:06 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[36800]: 2024-05-06T13:17:06.267+0000 7f544bffd700 -1 osd.7 179 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:17:07.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:06 smithi186 ceph-mon[83629]: osd.7 marked itself down and dead 2024-05-06T13:17:07.167 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:06 smithi016 ceph-mon[93192]: osd.7 marked itself down and dead 2024-05-06T13:17:07.167 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:06 smithi016 ceph-mon[102669]: osd.7 marked itself down and dead 2024-05-06T13:17:07.665 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:07 smithi186 podman[141590]: 2024-05-06 13:17:07.382489537 +0000 UTC m=+1.221725434 container died 89fd98d9078297b13b82508189d317093a14e450fe1b42c5ec67a3f9d7ee3290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, GIT_BRANCH=HEAD, name=centos-stream, RELEASE=HEAD, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, vendor=Red Hat, Inc., io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, release=754, version=8, maintainer=Guillaume Abrioux , ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870) 2024-05-06T13:17:07.950 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:07 smithi186 podman[141590]: 2024-05-06 13:17:07.823212677 +0000 UTC m=+1.662448619 container cleanup 89fd98d9078297b13b82508189d317093a14e450fe1b42c5ec67a3f9d7ee3290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, com.redhat.component=centos-stream-container, distribution-scope=public, release=754, architecture=x86_64, name=centos-stream, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, vcs-type=git, version=8) 2024-05-06T13:17:07.950 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:07 smithi186 bash[141590]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7 2024-05-06T13:17:07.950 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:07 smithi186 ceph-mon[83629]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:17:07.950 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:07 smithi186 ceph-mon[83629]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-06T13:17:07.950 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:07 smithi186 ceph-mon[83629]: osdmap e180: 8 total, 7 up, 8 in 2024-05-06T13:17:07.950 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:07 smithi186 ceph-mon[83629]: pgmap v312: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:08.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[93192]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:17:08.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[93192]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-06T13:17:08.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[93192]: osdmap e180: 8 total, 7 up, 8 in 2024-05-06T13:17:08.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[93192]: pgmap v312: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[102669]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-06T13:17:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[102669]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-06T13:17:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[102669]: osdmap e180: 8 total, 7 up, 8 in 2024-05-06T13:17:08.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:07 smithi016 ceph-mon[102669]: pgmap v312: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:08.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:08 smithi186 bash[141695]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7 2024-05-06T13:17:08.860 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:08 smithi186 podman[141651]: 2024-05-06 13:17:08.577454418 +0000 UTC m=+1.326042548 container remove 89fd98d9078297b13b82508189d317093a14e450fe1b42c5ec67a3f9d7ee3290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, io.buildah.version=1.19.8, vcs-type=git, name=centos-stream, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, ceph=True, io.openshift.expose-services=, version=8, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, release=754, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-06T13:17:08.860 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:08 smithi186 podman[141759]: 2024-05-06 13:17:08.662998297 +0000 UTC m=+0.017936029 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:17:08.860 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:08 smithi186 podman[141759]: 2024-05-06 13:17:08.761668572 +0000 UTC m=+0.116606294 container create 7337f4d3fca1cedced0baf35ddefd72e5ff81fc1c383ed40d8096058f6469843 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-05-06T13:17:09.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:08 smithi016 ceph-mon[93192]: osdmap e181: 8 total, 7 up, 8 in 2024-05-06T13:17:09.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:08 smithi016 ceph-mon[102669]: osdmap e181: 8 total, 7 up, 8 in 2024-05-06T13:17:09.234 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:08 smithi186 ceph-mon[83629]: osdmap e181: 8 total, 7 up, 8 in 2024-05-06T13:17:09.234 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:08 smithi186 podman[141759]: 2024-05-06 13:17:08.97357894 +0000 UTC m=+0.328516665 container init 7337f4d3fca1cedced0baf35ddefd72e5ff81fc1c383ed40d8096058f6469843 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-06T13:17:09.235 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:08 smithi186 podman[141759]: 2024-05-06 13:17:08.977069479 +0000 UTC m=+0.332007202 container start 7337f4d3fca1cedced0baf35ddefd72e5ff81fc1c383ed40d8096058f6469843 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.license=GPLv2) 2024-05-06T13:17:09.235 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:09 smithi186 podman[141759]: 2024-05-06 13:17:09.031124638 +0000 UTC m=+0.386062364 container attach 7337f4d3fca1cedced0baf35ddefd72e5ff81fc1c383ed40d8096058f6469843 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-06T13:17:09.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:09 smithi186 podman[141759]: 2024-05-06 13:17:09.276077708 +0000 UTC m=+0.631015434 container died 7337f4d3fca1cedced0baf35ddefd72e5ff81fc1c383ed40d8096058f6469843 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:17:10.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:09 smithi186 podman[141809]: 2024-05-06 13:17:09.851381137 +0000 UTC m=+0.569078766 container remove 7337f4d3fca1cedced0baf35ddefd72e5ff81fc1c383ed40d8096058f6469843 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-06T13:17:10.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:09 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.7.service: Deactivated successfully. 2024-05-06T13:17:10.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:09 smithi186 systemd[1]: Stopped Ceph osd.7 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:17:10.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:09 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.7.service: Consumed 11.903s CPU time. 2024-05-06T13:17:10.327 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 systemd[1]: Starting Ceph osd.7 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:17:10.327 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 podman[141914]: 2024-05-06 13:17:10.193178602 +0000 UTC m=+0.018050225 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:17:10.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:10 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:10 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:10.327 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:10 smithi186 ceph-mon[83629]: pgmap v314: 161 pgs: 14 active+undersized+degraded, 18 stale+active+clean, 17 active+undersized, 112 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 32/630 objects degraded (5.079%) 2024-05-06T13:17:10.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 podman[141914]: 2024-05-06 13:17:10.327833119 +0000 UTC m=+0.152704730 container create c7c6b79391f0629eef0e055d300f4ac01fd67ff9c1d1b49c01b558341f71612d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate, org.label-schema.build-date=20240430, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-06T13:17:10.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 podman[141914]: 2024-05-06 13:17:10.513823505 +0000 UTC m=+0.338695114 container init c7c6b79391f0629eef0e055d300f4ac01fd67ff9c1d1b49c01b558341f71612d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:17:10.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 podman[141914]: 2024-05-06 13:17:10.517318054 +0000 UTC m=+0.342189664 container start c7c6b79391f0629eef0e055d300f4ac01fd67ff9c1d1b49c01b558341f71612d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-06T13:17:10.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:10.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[93192]: pgmap v314: 161 pgs: 14 active+undersized+degraded, 18 stale+active+clean, 17 active+undersized, 112 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 32/630 objects degraded (5.079%) 2024-05-06T13:17:10.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:10.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:10.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:10 smithi016 ceph-mon[102669]: pgmap v314: 161 pgs: 14 active+undersized+degraded, 18 stale+active+clean, 17 active+undersized, 112 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 32/630 objects degraded (5.079%) 2024-05-06T13:17:10.961 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 podman[141914]: 2024-05-06 13:17:10.60552708 +0000 UTC m=+0.430398713 container attach c7c6b79391f0629eef0e055d300f4ac01fd67ff9c1d1b49c01b558341f71612d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:17:11.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-06T13:17:11.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-05-06T13:17:11.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-06T13:17:11.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 bash[141914]: --> ceph-volume raw activate successful for osd ID: 7 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate[141929]: --> ceph-volume raw activate successful for osd ID: 7 2024-05-06T13:17:11.217 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:10 smithi186 podman[141914]: 2024-05-06 13:17:10.98735725 +0000 UTC m=+0.812228853 container died c7c6b79391f0629eef0e055d300f4ac01fd67ff9c1d1b49c01b558341f71612d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:17:11.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:11 smithi186 ceph-mon[83629]: Health check failed: Degraded data redundancy: 32/630 objects degraded (5.079%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:17:11.674 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:11 smithi016 ceph-mon[93192]: Health check failed: Degraded data redundancy: 32/630 objects degraded (5.079%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:17:11.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:11 smithi016 ceph-mon[102669]: Health check failed: Degraded data redundancy: 32/630 objects degraded (5.079%), 14 pgs degraded (PG_DEGRADED) 2024-05-06T13:17:11.817 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:11 smithi186 podman[142063]: 2024-05-06 13:17:11.567498431 +0000 UTC m=+0.574277631 container remove c7c6b79391f0629eef0e055d300f4ac01fd67ff9c1d1b49c01b558341f71612d (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS) 2024-05-06T13:17:11.817 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:11 smithi186 podman[142127]: 2024-05-06 13:17:11.685516824 +0000 UTC m=+0.018343353 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:17:12.076 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:11 smithi186 podman[142127]: 2024-05-06 13:17:11.818436868 +0000 UTC m=+0.151263374 container create 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-06T13:17:12.076 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:12 smithi186 podman[142127]: 2024-05-06 13:17:12.054214153 +0000 UTC m=+0.387040669 container init 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-06T13:17:12.076 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:12 smithi186 podman[142127]: 2024-05-06 13:17:12.057235939 +0000 UTC m=+0.390062445 container start 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, ceph=True) 2024-05-06T13:17:12.363 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:12 smithi186 ceph-mon[83629]: pgmap v315: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:12.364 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:12.364 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:12 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:12.364 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:12 smithi186 ceph-osd[142146]: -- 172.21.15.186:0/17565583 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652c6355680 con 0x5652c631f000 2024-05-06T13:17:12.364 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:12 smithi186 bash[142127]: 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 2024-05-06T13:17:12.365 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:12 smithi186 systemd[1]: Started Ceph osd.7 for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:17:12.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:12 smithi016 ceph-mon[93192]: pgmap v315: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:12.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:12.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:12 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:12.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:12 smithi016 ceph-mon[102669]: pgmap v315: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:12.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:12.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:12 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:12.699 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:12 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:17:12.597+0000 7fda0cf7d7c0 -1 Falling back to public interface 2024-05-06T13:17:14.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:13 smithi186 ceph-mon[83629]: pgmap v316: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:14.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[102669]: pgmap v316: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:14.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:13 smithi016 ceph-mon[93192]: pgmap v316: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:14.858 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:17:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:17:14] "GET /metrics HTTP/1.1" 200 38545 "" "Prometheus/2.33.4" 2024-05-06T13:17:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:14 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:14 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.629 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:17:15.335+0000 7fda0cf7d7c0 -1 osd.7 0 read_superblock omap replica is missing. 2024-05-06T13:17:15.630 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:15 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:17:15.373+0000 7fda0cf7d7c0 -1 osd.7 179 log_to_monitors true 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.916 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.917 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.918 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: pgmap v317: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:15.919 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:15 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: pgmap v317: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: pgmap v317: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:16.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:15 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:16.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:17:16 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:17:16.323+0000 7fd9fe3d4700 -1 osd.7 179 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.044 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: osdmap e182: 8 total, 7 up, 8 in 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:17:17.045 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.046 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.047 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.048 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.048 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:16 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: osdmap e182: 8 total, 7 up, 8 in 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: osdmap e182: 8 total, 7 up, 8 in 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:17.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:16 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035] boot 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: osdmap e183: 8 total, 8 up, 8 in 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:17:18.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035] boot 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: osdmap e183: 8 total, 8 up, 8 in 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[93192]: pgmap v320: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:17 smithi016 ceph-mon[102669]: pgmap v320: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: osd.7 [v2:172.21.15.186:6824/1579351035,v1:172.21.15.186:6825/1579351035] boot 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: osdmap e183: 8 total, 8 up, 8 in 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:18.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:18.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:18.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:18.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:18.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:17 smithi186 ceph-mon[83629]: pgmap v320: 161 pgs: 28 active+undersized+degraded, 41 active+undersized, 92 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 83/630 objects degraded (13.175%) 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: osdmap e184: 8 total, 8 up, 8 in 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:18 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:19.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: osdmap e184: 8 total, 8 up, 8 in 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: osdmap e184: 8 total, 8 up, 8 in 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:19.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:18 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.161 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.162 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Health check update: Degraded data redundancy: 83/630 objects degraded (13.175%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.163 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: pgmap v322: 161 pgs: 16 peering, 17 active+undersized+degraded, 26 active+undersized, 102 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/630 objects degraded (9.206%) 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.164 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:20.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Health check update: Degraded data redundancy: 83/630 objects degraded (13.175%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Health check update: Degraded data redundancy: 83/630 objects degraded (13.175%), 28 pgs degraded (PG_DEGRADED) 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: pgmap v322: 161 pgs: 16 peering, 17 active+undersized+degraded, 26 active+undersized, 102 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/630 objects degraded (9.206%) 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: pgmap v322: 161 pgs: 16 peering, 17 active+undersized+degraded, 26 active+undersized, 102 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/630 objects degraded (9.206%) 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:20.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:20 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:21.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:20 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: pgmap v323: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: pgmap v323: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.184 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:21 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: pgmap v323: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:22.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:21 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.183 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/630 objects degraded (9.206%), 17 pgs degraded) 2024-05-06T13:17:23.184 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.185 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.185 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.186 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.187 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/630 objects degraded (9.206%), 17 pgs degraded) 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.188 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.189 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.190 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.190 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.190 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.191 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:22 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.197 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.198 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.199 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.200 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.201 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.202 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/630 objects degraded (9.206%), 17 pgs degraded) 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:23.203 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:23.204 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:22 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:17:24.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:23 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:24.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:23 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:24.673 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:17:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:17:24] "GET /metrics HTTP/1.1" 200 38492 "" "Prometheus/2.33.4" 2024-05-06T13:17:25.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:25.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.183 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.184 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.185 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:17:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:26.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:26.409 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.025 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.026 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.027 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.028 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.029 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.030 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.031 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='client.44742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.032 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.033 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='client.44742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:27.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.034 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.131 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:17:27.131 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 6s ago 21m - - 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 17s ago 21m - - 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (11m) 6s ago 15m 23.7M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (10m) 17s ago 15m 53.4M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (9m) 6s ago 14m 66.2M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (10m) 17s ago 20m 540M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (8m) 6s ago 22m 453M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (8m) 6s ago 22m 76.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (7m) 17s ago 20m 58.8M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (7m) 6s ago 20m 65.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (11m) 6s ago 16m 19.0M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (10m) 17s ago 16m 18.4M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (6m) 6s ago 20m 65.7M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (5m) 6s ago 19m 54.9M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:17:27.132 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (4m) 6s ago 19m 49.7M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (3m) 6s ago 18m 56.4M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (3m) 17s ago 18m 48.2M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (115s) 17s ago 18m 54.8M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (50s) 17s ago 17m 41.4M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ce2aaac07e20 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 starting - - - 4096M 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (9m) 17s ago 16m 68.9M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (15m) 6s ago 15m 77.4M - 17.2.0 e1d6a67b021e f6b590c1aedf 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (15m) 17s ago 15m 75.3M - 17.2.0 e1d6a67b021e 8004c9264f6b 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (14m) 6s ago 14m 77.0M - 17.2.0 e1d6a67b021e 7ffc3b85109a 2024-05-06T13:17:27.133 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (14m) 17s ago 14m 74.9M - 17.2.0 e1d6a67b021e cf2b873e7535 2024-05-06T13:17:27.170 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.171 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.172 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.173 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.174 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:27.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:27.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:27.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:27.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='client.44742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:27.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:27.175 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:27.569 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:17:27.569 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:17:27.569 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:17:27.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:27.569 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:17:27.569 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 13 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:17:27.570 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:17:27.921 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:17:27.921 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:17:27.921 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "13/23 daemons upgraded", 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:17:27.922 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:17:28.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:28.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all osd 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T13:17:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: Upgrade: Setting require_osd_release to 19 squid 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2947969953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[102669]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all osd 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-06T13:17:28.180 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-05-06T13:17:28.181 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: Upgrade: Setting require_osd_release to 19 squid 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2947969953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.182 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:27 smithi016 ceph-mon[93192]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:28.186 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all osd 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.187 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-06T13:17:28.188 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: Upgrade: Setting require_osd_release to 19 squid 2024-05-06T13:17:28.189 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T13:17:28.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-06T13:17:28.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:28.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2947969953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:28.190 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:27 smithi186 ceph-mon[83629]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:28.363 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN all OSDs are running squid or later but require_osd_release < squid 2024-05-06T13:17:28.363 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-05-06T13:17:28.364 INFO:teuthology.orchestra.run.smithi016.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-05-06T13:17:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3926091592' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:17:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-06T13:17:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:17:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-06T13:17:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: osdmap e185: 8 total, 8 up, 8 in 2024-05-06T13:17:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all mds 2024-05-06T13:17:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3926091592' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:17:29.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: osdmap e185: 8 total, 8 up, 8 in 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all mds 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3926091592' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:17:29.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-06T13:17:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: osdmap e185: 8 total, 8 up, 8 in 2024-05-06T13:17:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all mds 2024-05-06T13:17:29.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:30.143 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:29 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:30.144 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:29 smithi016 ceph-mon[93192]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:30.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:29 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:30.144 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:29 smithi016 ceph-mon[102669]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:30.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:29 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:30.208 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:29 smithi186 ceph-mon[83629]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:32.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.foo.smithi016.pgdorv (1/4) 2024-05-06T13:17:32.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:32.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: Deploying daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[102669]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.foo.smithi016.pgdorv (1/4) 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: Deploying daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:17:32.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:31 smithi016 ceph-mon[93192]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.foo.smithi016.pgdorv (1/4) 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi016.pgdorv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: Deploying daemon rgw.foo.smithi016.pgdorv on smithi016 2024-05-06T13:17:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:31 smithi186 ceph-mon[83629]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:34.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:34.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:34.136 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:34.137 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[93192]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:34.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:34.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:34.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:34.137 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:33 smithi016 ceph-mon[102669]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:33 smithi186 ceph-mon[83629]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:17:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:17:34] "GET /metrics HTTP/1.1" 200 38633 "" "Prometheus/2.33.4" 2024-05-06T13:17:36.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:36.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:36 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:36.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:36 smithi186 ceph-mon[83629]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:36.868 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:36.868 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:36 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:36.868 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:36 smithi016 ceph-mon[93192]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:36.868 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:36.868 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:36 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:36.868 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:36 smithi016 ceph-mon[102669]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-06T13:17:38.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[93192]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 54 op/s 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[102669]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 54 op/s 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:38.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:37 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:37 smithi186 ceph-mon[83629]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 35 KiB/s rd, 0 B/s wr, 54 op/s 2024-05-06T13:17:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:37 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:38.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:37 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:39.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:38 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.smpl.smithi016.rbmnkc (2/4) 2024-05-06T13:17:39.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:38 smithi016 ceph-mon[102669]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:17:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:38 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.smpl.smithi016.rbmnkc (2/4) 2024-05-06T13:17:39.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:38 smithi016 ceph-mon[93192]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:17:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:38 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.smpl.smithi016.rbmnkc (2/4) 2024-05-06T13:17:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:38 smithi186 ceph-mon[83629]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:17:40.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:39 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:40.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:39 smithi016 ceph-mon[102669]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 89 B/s wr, 88 op/s 2024-05-06T13:17:40.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:39 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:40.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:39 smithi016 ceph-mon[93192]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 89 B/s wr, 88 op/s 2024-05-06T13:17:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:39 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:40.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:39 smithi186 ceph-mon[83629]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 89 B/s wr, 88 op/s 2024-05-06T13:17:41.544 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.544 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.545 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.546 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.546 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:41 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:41.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:41 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:42.559 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:42 smithi016 ceph-mon[93192]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-05-06T13:17:42.559 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:42 smithi016 ceph-mon[102669]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-05-06T13:17:42.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:42 smithi186 ceph-mon[83629]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s rd, 85 B/s wr, 84 op/s 2024-05-06T13:17:44.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:44.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:43 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:44.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:44.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:43 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:44.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:43 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:44.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:17:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:17:44] "GET /metrics HTTP/1.1" 200 38633 "" "Prometheus/2.33.4" 2024-05-06T13:17:45.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:44 smithi186 ceph-mon[83629]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 170 B/s wr, 107 op/s 2024-05-06T13:17:45.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:45.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:45.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:44 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:45.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:44 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[93192]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 170 B/s wr, 107 op/s 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[102669]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 170 B/s wr, 107 op/s 2024-05-06T13:17:45.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:45.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:44 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:46.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:45 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.foo.smithi186.wuvklh (3/4) 2024-05-06T13:17:46.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:45 smithi186 ceph-mon[83629]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:17:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:45 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.foo.smithi186.wuvklh (3/4) 2024-05-06T13:17:46.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:45 smithi016 ceph-mon[93192]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:17:46.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:45 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.foo.smithi186.wuvklh (3/4) 2024-05-06T13:17:46.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:45 smithi016 ceph-mon[102669]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:17:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:46 smithi186 ceph-mon[83629]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 170 B/s wr, 119 op/s 2024-05-06T13:17:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:46 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[93192]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 170 B/s wr, 119 op/s 2024-05-06T13:17:47.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[102669]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 170 B/s wr, 119 op/s 2024-05-06T13:17:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:46 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:47.820 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:47 smithi186 ceph-mon[83629]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 118 KiB/s rd, 188 B/s wr, 181 op/s 2024-05-06T13:17:47.820 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:47 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:17:47.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:47 smithi016 ceph-mon[102669]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 118 KiB/s rd, 188 B/s wr, 181 op/s 2024-05-06T13:17:47.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:47 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:17:47.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:47 smithi016 ceph-mon[93192]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 118 KiB/s rd, 188 B/s wr, 181 op/s 2024-05-06T13:17:47.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:47 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:17:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[93192]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 188 B/s wr, 136 op/s 2024-05-06T13:17:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:48 smithi016 ceph-mon[102669]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 188 B/s wr, 136 op/s 2024-05-06T13:17:49.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:17:49.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:48 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:49.196 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:48 smithi186 ceph-mon[83629]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 188 B/s wr, 136 op/s 2024-05-06T13:17:50.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:50 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:50.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:50 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:51.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:50 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:17:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:51 smithi186 ceph-mon[83629]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 94 B/s wr, 106 op/s 2024-05-06T13:17:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:51 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:52.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:51 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:52.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[93192]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 94 B/s wr, 106 op/s 2024-05-06T13:17:52.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:52.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:52.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:52.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[102669]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 94 B/s wr, 106 op/s 2024-05-06T13:17:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:17:52.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:51 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:53.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:52 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.smpl.smithi186.dsrbux (4/4) 2024-05-06T13:17:53.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:52 smithi186 ceph-mon[83629]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:17:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:52 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.smpl.smithi186.dsrbux (4/4) 2024-05-06T13:17:53.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:52 smithi016 ceph-mon[93192]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:17:53.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:52 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.smpl.smithi186.dsrbux (4/4) 2024-05-06T13:17:53.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:52 smithi016 ceph-mon[102669]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:17:53.851 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:53 smithi186 ceph-mon[83629]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 94 B/s wr, 155 op/s 2024-05-06T13:17:54.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:53 smithi016 ceph-mon[93192]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 94 B/s wr, 155 op/s 2024-05-06T13:17:54.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:53 smithi016 ceph-mon[102669]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 94 B/s wr, 155 op/s 2024-05-06T13:17:54.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:17:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:17:54] "GET /metrics HTTP/1.1" 200 38647 "" "Prometheus/2.33.4" 2024-05-06T13:17:56.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:55 smithi186 ceph-mon[83629]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 94 B/s wr, 159 op/s 2024-05-06T13:17:56.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:55 smithi016 ceph-mon[93192]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 94 B/s wr, 159 op/s 2024-05-06T13:17:56.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:55 smithi016 ceph-mon[102669]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 94 B/s wr, 159 op/s 2024-05-06T13:17:57.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.235 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 99 B/s wr, 154 op/s 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: Checking dashboard <-> RGW credentials 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.236 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.237 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:57 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 99 B/s wr, 154 op/s 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: Checking dashboard <-> RGW credentials 2024-05-06T13:17:57.260 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.261 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.262 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 99 B/s wr, 154 op/s 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: Checking dashboard <-> RGW credentials 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.263 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:57.264 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:57.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:57.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:57.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:57.265 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:57 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:17:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:17:58.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:17:58.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.182 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:58 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:58.270 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:58.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:58 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:58.775 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 178 B/s wr, 122 op/s 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 178 B/s wr, 122 op/s 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='client.64798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='client.64798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:17:59 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.500 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:17:59.500 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 18s ago 21m - - 2024-05-06T13:17:59.500 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 12s ago 21m - - 2024-05-06T13:17:59.500 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (11m) 18s ago 16m 23.7M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:17:59.500 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (11m) 12s ago 16m 54.0M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:17:59.500 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (10m) 18s ago 15m 66.2M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (10m) 12s ago 20m 541M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (9m) 18s ago 22m 453M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (8m) 18s ago 22m 77.7M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (7m) 12s ago 21m 63.3M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (8m) 18s ago 21m 65.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (11m) 18s ago 17m 19.3M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (11m) 12s ago 16m 18.0M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (6m) 18s ago 20m 66.6M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (5m) 18s ago 20m 56.0M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (5m) 18s ago 19m 49.8M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (4m) 18s ago 19m 57.3M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (3m) 12s ago 19m 52.0M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (2m) 12s ago 18m 57.7M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (83s) 12s ago 18m 44.3M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ce2aaac07e20 2024-05-06T13:17:59.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (47s) 12s ago 18m 47.0M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 208a025316fc 2024-05-06T13:17:59.502 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (10m) 12s ago 17m 68.9M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:17:59.502 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (24s) 18s ago 15m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 67d50c896ef3 2024-05-06T13:17:59.502 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 starting - - - - 2024-05-06T13:17:59.502 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 starting - - - - 2024-05-06T13:17:59.502 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 starting - - - - 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 178 B/s wr, 122 op/s 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='client.64798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.517 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:17:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:17:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:17:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:17:59.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:17:59 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:17:59.935 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:17:59.935 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 4 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 17 2024-05-06T13:17:59.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:17:59.937 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:18:00.304 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:18:00.304 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:18:00.304 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:18:00.304 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:18:00.304 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:18:00.304 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "14/23 daemons upgraded", 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading rgw daemons", 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:18:00.305 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='client.64804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.406 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='client.64810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:00.407 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.408 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2023581885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.409 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.410 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.410 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:00 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='client.64804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='client.64810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='client.64804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='client.64810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2023581885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2023581885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:00.432 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:00.433 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:00 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:00.740 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:18:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 178 B/s wr, 145 op/s 2024-05-06T13:18:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='client.64822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:01.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/119903485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.269 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:01 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.396 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 178 B/s wr, 145 op/s 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.397 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='client.64822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.398 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.399 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 178 B/s wr, 145 op/s 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.400 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='client.64822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/119903485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/119903485' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:01.406 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:01 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.431 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:02 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:02.440 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:02.441 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:02 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 178 B/s wr, 165 op/s 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.267 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.268 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 178 B/s wr, 165 op/s 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.368 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.369 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:03.370 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.371 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 178 B/s wr, 165 op/s 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.372 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.373 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:03.374 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.399 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.400 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.401 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.402 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.403 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.404 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.405 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.406 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:04 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.452 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.453 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.454 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.455 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:04.456 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:04.456 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:04.456 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:04.456 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:04 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:04.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:18:04] "GET /metrics HTTP/1.1" 200 38648 "" "Prometheus/2.33.4" 2024-05-06T13:18:05.280 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.280 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 178 B/s wr, 119 op/s 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.281 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.282 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.283 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.284 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:05 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 178 B/s wr, 119 op/s 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 178 B/s wr, 119 op/s 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:05.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:05.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:05.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:05.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:05.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:05 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.256 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.257 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.258 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.259 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.259 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:06 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.427 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.429 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:06.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:06 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 89 B/s wr, 90 op/s 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.426 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.427 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 95 B/s wr, 97 op/s 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.428 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:18:07.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.429 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 89 B/s wr, 90 op/s 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.430 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.431 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.432 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 95 B/s wr, 97 op/s 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.433 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:07 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 89 B/s wr, 90 op/s 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.434 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.435 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 95 B/s wr, 97 op/s 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:07.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:07 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 72 op/s 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.969 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 72 op/s 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:08.970 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:08 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 72 op/s 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:08 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.872 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:18:09.872 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: Cluster is now healthy 2024-05-06T13:18:09.872 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:09.872 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: Cluster is now healthy 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:09.873 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.874 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:09.874 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:09 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: Cluster is now healthy 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi016.rbmnkc", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:10.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:09 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:10.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.smpl.smithi016.rbmnkc (1/3) 2024-05-06T13:18:10.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[102669]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:18:10.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:10.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[102669]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 39 op/s 2024-05-06T13:18:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.smpl.smithi016.rbmnkc (1/3) 2024-05-06T13:18:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[93192]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:18:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:10.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:10 smithi016 ceph-mon[93192]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 39 op/s 2024-05-06T13:18:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:10 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.smpl.smithi016.rbmnkc (1/3) 2024-05-06T13:18:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:10 smithi186 ceph-mon[83629]: Deploying daemon rgw.smpl.smithi016.rbmnkc on smithi016 2024-05-06T13:18:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:10 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:11.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:10 smithi186 ceph-mon[83629]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 39 op/s 2024-05-06T13:18:13.111 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:12 smithi016 ceph-mon[93192]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:18:13.111 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:12 smithi016 ceph-mon[102669]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:18:13.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:12 smithi186 ceph-mon[83629]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-05-06T13:18:14.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:14.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:14.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:14 smithi186 ceph-mon[83629]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 9.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-06T13:18:14.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:14.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:14.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:14 smithi016 ceph-mon[102669]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 9.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-06T13:18:14.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:14.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:14.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:14 smithi016 ceph-mon[93192]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 9.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-05-06T13:18:14.845 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:18:14] "GET /metrics HTTP/1.1" 200 38648 "" "Prometheus/2.33.4" 2024-05-06T13:18:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:15 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.foo.smithi186.wuvklh (2/3) 2024-05-06T13:18:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:15 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:15.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:15 smithi186 ceph-mon[83629]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:18:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.foo.smithi186.wuvklh (2/3) 2024-05-06T13:18:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:15.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[93192]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:18:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.foo.smithi186.wuvklh (2/3) 2024-05-06T13:18:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi186.wuvklh", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:15.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:15 smithi016 ceph-mon[102669]: Deploying daemon rgw.foo.smithi186.wuvklh on smithi186 2024-05-06T13:18:16.457 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:16 smithi186 ceph-mon[83629]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-05-06T13:18:16.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:16 smithi016 ceph-mon[93192]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-05-06T13:18:16.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:16 smithi016 ceph-mon[102669]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-05-06T13:18:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:18 smithi016 ceph-mon[93192]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 75 op/s 2024-05-06T13:18:19.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:19.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:18 smithi016 ceph-mon[102669]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 75 op/s 2024-05-06T13:18:19.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:18 smithi186 ceph-mon[83629]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 75 op/s 2024-05-06T13:18:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:20.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[93192]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 85 B/s wr, 96 op/s 2024-05-06T13:18:20.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:20.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:19 smithi016 ceph-mon[102669]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 85 B/s wr, 96 op/s 2024-05-06T13:18:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:19 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:20.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:19 smithi186 ceph-mon[83629]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 85 B/s wr, 96 op/s 2024-05-06T13:18:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[93192]: Upgrade: Updating rgw.smpl.smithi186.dsrbux (3/3) 2024-05-06T13:18:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:21.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[93192]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:18:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[102669]: Upgrade: Updating rgw.smpl.smithi186.dsrbux (3/3) 2024-05-06T13:18:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:21.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:20 smithi016 ceph-mon[102669]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:18:21.244 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:20 smithi186 ceph-mon[83629]: Upgrade: Updating rgw.smpl.smithi186.dsrbux (3/3) 2024-05-06T13:18:21.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:21.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi186.dsrbux", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-06T13:18:21.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:21.245 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:20 smithi186 ceph-mon[83629]: Deploying daemon rgw.smpl.smithi186.dsrbux on smithi186 2024-05-06T13:18:22.101 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:21 smithi186 ceph-mon[83629]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 85 B/s wr, 140 op/s 2024-05-06T13:18:22.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:21 smithi016 ceph-mon[93192]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 85 B/s wr, 140 op/s 2024-05-06T13:18:22.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:21 smithi016 ceph-mon[102669]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 85 B/s wr, 140 op/s 2024-05-06T13:18:24.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:18:24] "GET /metrics HTTP/1.1" 200 38676 "" "Prometheus/2.33.4" 2024-05-06T13:18:24.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 170 B/s wr, 168 op/s 2024-05-06T13:18:24.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:24.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 170 B/s wr, 168 op/s 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:24.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:24.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:24.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:24.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:24.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:24.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:24.925 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:24 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:25.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 170 B/s wr, 168 op/s 2024-05-06T13:18:25.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:25.091 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:25.092 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:24 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: Checking dashboard <-> RGW credentials 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: Checking dashboard <-> RGW credentials 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:25 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: Checking dashboard <-> RGW credentials 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.248 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.249 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.250 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:25 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.940 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.940 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 170 B/s wr, 157 op/s 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.941 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.942 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:26.943 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:26.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:26.944 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:26 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 170 B/s wr, 157 op/s 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 170 B/s wr, 157 op/s 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:27.181 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:26 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.114 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.117 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.118 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:27 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.174 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.175 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.177 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.178 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:28.179 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:28.180 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:27 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 170 B/s wr, 191 op/s 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.017 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.018 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.019 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:28 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.063 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 170 B/s wr, 191 op/s 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.064 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.065 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.066 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.068 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 292 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 170 B/s wr, 191 op/s 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.069 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.071 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:29.072 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:28 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.138 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.139 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.140 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]': finished 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]: dispatch 2024-05-06T13:18:30.141 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]': finished 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]': finished 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]': finished 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.142 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:29 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.169 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.171 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]': finished 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]': finished 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]: dispatch 2024-05-06T13:18:30.175 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]: dispatch 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]': finished 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]: dispatch 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]: dispatch 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]': finished 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.176 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.177 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi016.pgdorv"}]': finished 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]: dispatch 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi186.wuvklh"}]': finished 2024-05-06T13:18:30.178 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi016.rbmnkc"}]': finished 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi186.dsrbux"}]': finished 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:30.179 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:29 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all rgw 2024-05-06T13:18:30.969 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all rbd-mirror 2024-05-06T13:18:30.970 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: Upgrade: Setting container_image for all ceph-exporter 2024-05-06T13:18:30.970 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:30 smithi186 ceph-mon[83629]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s rd, 255 B/s wr, 186 op/s 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.118 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all rgw 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all rbd-mirror 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: Upgrade: Setting container_image for all ceph-exporter 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[93192]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s rd, 255 B/s wr, 186 op/s 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-06T13:18:31.119 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all rgw 2024-05-06T13:18:31.120 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all rbd-mirror 2024-05-06T13:18:31.120 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: Upgrade: Setting container_image for all ceph-exporter 2024-05-06T13:18:31.120 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:30 smithi016 ceph-mon[102669]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s rd, 255 B/s wr, 186 op/s 2024-05-06T13:18:31.120 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:18:31.807 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 0s ago 22m - - 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 3s ago 22m - - 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (12m) 0s ago 17m 23.8M - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (11m) 3s ago 16m 54.0M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (10m) 0s ago 15m 66.2M - 3.5 e1d6a67b021e c70df65da7e4 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (11m) 3s ago 21m 544M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (9m) 0s ago 23m 453M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (9m) 0s ago 23m 80.0M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (8m) 3s ago 21m 63.5M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (8m) 0s ago 21m 67.1M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (12m) 0s ago 17m 18.7M - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (11m) 3s ago 17m 21.2M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:18:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 0s ago 21m 70.4M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (6m) 0s ago 20m 60.8M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (5m) 0s ago 20m 54.0M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (4m) 0s ago 20m 62.4M 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (4m) 3s ago 19m 59.1M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (3m) 3s ago 19m 61.9M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (115s) 3s ago 18m 50.0M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ce2aaac07e20 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (80s) 3s ago 18m 52.4M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 208a025316fc 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (10m) 3s ago 17m 68.9M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (56s) 0s ago 16m 75.4M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 67d50c896ef3 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (43s) 3s ago 16m 74.2M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ab7799124d48 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (19s) 0s ago 15m 77.4M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 827ac11ab93a 2024-05-06T13:18:31.809 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (36s) 3s ago 15m 75.1M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 61bdd25efbc1 2024-05-06T13:18:32.235 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:18:32.235 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:18:32.235 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 4 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 17 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:18:32.236 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw", 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "17/23 daemons upgraded", 2024-05-06T13:18:32.585 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading iscsi daemons", 2024-05-06T13:18:32.586 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-05-06T13:18:32.586 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:18:32.829 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 170 B/s wr, 158 op/s 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='client.45024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2349900433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.830 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.831 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.831 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.831 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 170 B/s wr, 158 op/s 2024-05-06T13:18:32.831 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='client.45024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.831 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:32 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2349900433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 170 B/s wr, 158 op/s 2024-05-06T13:18:32.914 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='client.45024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:32.915 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:32 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2349900433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:18:33.008 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-05-06T13:18:33.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:33 smithi186 ceph-mon[83629]: from='client.45036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:33.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:33.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:33 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3561562674' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:18:33.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[93192]: from='client.45036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:33.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:33.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3561562674' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:18:33.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[102669]: from='client.45036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3561562674' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:33.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: Upgrade: Updating iscsi.foo.smithi016.oxwhiv 2024-05-06T13:18:34.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:18:34.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:18:34.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:34.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: Deploying daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:18:34.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 170 B/s wr, 114 op/s 2024-05-06T13:18:34.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: Upgrade: Updating iscsi.foo.smithi016.oxwhiv 2024-05-06T13:18:34.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:18:34.926 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: Deploying daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 170 B/s wr, 114 op/s 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:34.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:18:34] "GET /metrics HTTP/1.1" 200 38700 "" "Prometheus/2.33.4" 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: Upgrade: Updating iscsi.foo.smithi016.oxwhiv 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi016.oxwhiv", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-06T13:18:35.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: Deploying daemon iscsi.foo.smithi016.oxwhiv on smithi016 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 170 B/s wr, 114 op/s 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:35.016 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:37.070 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:36 smithi016 ceph-mon[93192]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-05-06T13:18:37.070 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:36 smithi016 ceph-mon[102669]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-05-06T13:18:37.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:36 smithi186 ceph-mon[83629]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-05-06T13:18:39.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:38 smithi016 ceph-mon[93192]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-05-06T13:18:39.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:38 smithi016 ceph-mon[102669]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-05-06T13:18:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:38 smithi186 ceph-mon[83629]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-05-06T13:18:41.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:40 smithi016 ceph-mon[93192]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:41.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:40 smithi016 ceph-mon[93192]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 85 B/s wr, 41 op/s 2024-05-06T13:18:41.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:40 smithi016 ceph-mon[102669]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:41.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:40 smithi016 ceph-mon[102669]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 85 B/s wr, 41 op/s 2024-05-06T13:18:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:40 smithi186 ceph-mon[83629]: from='client.35222 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:18:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:40 smithi186 ceph-mon[83629]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 85 B/s wr, 41 op/s 2024-05-06T13:18:43.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:42 smithi016 ceph-mon[93192]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:43.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:42 smithi016 ceph-mon[102669]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:42 smithi186 ceph-mon[83629]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:44 smithi186 ceph-mon[83629]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:18:45.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:18:44] "GET /metrics HTTP/1.1" 200 38700 "" "Prometheus/2.33.4" 2024-05-06T13:18:45.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:44 smithi016 ceph-mon[93192]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:18:45.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:44 smithi016 ceph-mon[102669]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:18:47.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:46 smithi016 ceph-mon[93192]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:47.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:46 smithi016 ceph-mon[102669]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:47.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:46 smithi186 ceph-mon[83629]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:49.158 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:18:48.855+0000 7f99ff273700 -1 log_channel(cephadm) log [ERR] : Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:18:49.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:48 smithi186 ceph-mon[83629]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:49.159 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:48 smithi016 ceph-mon[102669]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:49.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:48 smithi016 ceph-mon[93192]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:18:49.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:49.904 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:49.905 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:49 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:50.116 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:49 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:51.080 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:50 smithi186 ceph-mon[83629]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:18:51.080 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:50 smithi186 ceph-mon[83629]: Health check failed: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-05-06T13:18:51.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:50 smithi016 ceph-mon[93192]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:18:51.107 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:50 smithi016 ceph-mon[93192]: Health check failed: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-05-06T13:18:51.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:50 smithi016 ceph-mon[102669]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:18:51.107 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:50 smithi016 ceph-mon[102669]: Health check failed: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-05-06T13:18:52.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:52 smithi016 ceph-mon[93192]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 op/s 2024-05-06T13:18:52.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:52 smithi016 ceph-mon[102669]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 op/s 2024-05-06T13:18:53.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:52 smithi186 ceph-mon[83629]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 op/s 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:18:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:18:54] "GET /metrics HTTP/1.1" 200 38694 "" "Prometheus/2.33.4" 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 op/s 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 op/s 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.104 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 828 B/s rd, 0 op/s 2024-05-06T13:18:55.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:55.105 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 368 B/s rd, 0 op/s 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 406 B/s rd, 0 op/s 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 505 B/s rd, 0 op/s 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:18:56.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 368 B/s rd, 0 op/s 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 406 B/s rd, 0 op/s 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 505 B/s rd, 0 op/s 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:18:56.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:56 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 368 B/s rd, 0 op/s 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 406 B/s rd, 0 op/s 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:18:57.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:18:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 505 B/s rd, 0 op/s 2024-05-06T13:18:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:18:57.266 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:56 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:18:58.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:57 smithi016 ceph-mon[102669]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:18:58.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:57 smithi016 ceph-mon[93192]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:18:58.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:57 smithi186 ceph-mon[83629]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-06T13:18:59.170 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:58 smithi016 ceph-mon[93192]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:18:59.170 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:58 smithi016 ceph-mon[102669]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:18:59.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:58 smithi186 ceph-mon[83629]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:00.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:18:59 smithi016 ceph-mon[93192]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:00.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:18:59 smithi016 ceph-mon[102669]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:00.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:18:59 smithi186 ceph-mon[83629]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:01.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:00 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/561610065' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:19:01.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:00 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/561610065' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:19:01.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:00 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/561610065' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-06T13:19:02.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:01 smithi016 ceph-mon[93192]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:02.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:01 smithi016 ceph-mon[102669]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:02.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:01 smithi186 ceph-mon[83629]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:03.386 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:19:03.728 INFO:teuthology.orchestra.run.smithi016.stdout:"Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed." 2024-05-06T13:19:04.044 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:04.044 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:04.044 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[93192]: from='client.45072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:04.044 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[93192]: from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:04.044 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[93192]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 0 op/s 2024-05-06T13:19:04.044 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:04.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:04.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[102669]: from='client.45072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:04.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[102669]: from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:04.045 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:03 smithi016 ceph-mon[102669]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 0 op/s 2024-05-06T13:19:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:03 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:03 smithi186 ceph-mon[83629]: from='client.45072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:03 smithi186 ceph-mon[83629]: from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:04.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:03 smithi186 ceph-mon[83629]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 0 op/s 2024-05-06T13:19:04.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch ps' 2024-05-06T13:19:05.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:19:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:19:04] "GET /metrics HTTP/1.1" 200 38773 "" "Prometheus/2.33.4" 2024-05-06T13:19:06.086 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:05 smithi016 ceph-mon[93192]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 409 B/s rd, 0 op/s 2024-05-06T13:19:06.087 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:05 smithi016 ceph-mon[102669]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 409 B/s rd, 0 op/s 2024-05-06T13:19:06.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:05 smithi186 ceph-mon[83629]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 409 B/s rd, 0 op/s 2024-05-06T13:19:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:19:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 10s ago 22m - - 2024-05-06T13:19:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 12s ago 22m - - 2024-05-06T13:19:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (12m) 10s ago 17m - - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:19:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (12m) 12s ago 17m 54.5M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:19:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 unknown 10s ago 16m - - 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (11m) 12s ago 22m 544M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (10m) 10s ago 23m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (9m) 10s ago 23m - 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (8m) 12s ago 22m 63.7M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (9m) 10s ago 22m - 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (12m) 10s ago 18m - - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (12m) 12s ago 18m 18.4M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 10s ago 21m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (6m) 10s ago 21m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (6m) 10s ago 20m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (5m) 10s ago 20m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (4m) 12s ago 20m 59.4M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (3m) 12s ago 19m 61.1M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:19:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (2m) 12s ago 19m 49.5M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ce2aaac07e20 2024-05-06T13:19:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (114s) 12s ago 19m 51.5M 4096M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 208a025316fc 2024-05-06T13:19:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (11m) 12s ago 18m 68.9M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:19:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (91s) 10s ago 16m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 67d50c896ef3 2024-05-06T13:19:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (48s) 12s ago 16m 74.4M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f65362386d05 2024-05-06T13:19:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (53s) 10s ago 16m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 827ac11ab93a 2024-05-06T13:19:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (42s) 12s ago 16m 74.3M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 46d4a4d10bed 2024-05-06T13:19:07.160 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:06 smithi016 ceph-mon[93192]: from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:07.160 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:06 smithi016 ceph-mon[102669]: from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:07.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph versions' 2024-05-06T13:19:07.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:06 smithi186 ceph-mon[83629]: from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:19:08.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:07 smithi016 ceph-mon[93192]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-06T13:19:08.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:07 smithi016 ceph-mon[102669]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-06T13:19:08.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:07 smithi186 ceph-mon[83629]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-06T13:19:09.369 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:19:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:19:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:19:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:19:09.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 4 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 17 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:19:09.370 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:19:09.665 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:09 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4184419522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:19:09.665 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:09 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/4184419522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:19:09.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:09 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/4184419522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:19:10.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-05-06T13:19:10.620 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:10 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:10.620 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:10 smithi016 ceph-mon[93192]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:19:10.620 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:10 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:10.620 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:10 smithi016 ceph-mon[102669]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:19:10.623 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:10 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:10.623 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:10 smithi186 ceph-mon[83629]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:19:11.826 INFO:teuthology.orchestra.run.smithi016.stdout:wait for servicemap items w/ changing names to refresh 2024-05-06T13:19:12.172 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:11 smithi016 ceph-mon[93192]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:19:12.172 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:11 smithi016 ceph-mon[102669]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:19:12.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:11 smithi186 ceph-mon[83629]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-06T13:19:12.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'sleep 60' 2024-05-06T13:19:13.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:13 smithi016 ceph-mon[93192]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:13.957 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:13 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:13.957 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:13 smithi016 ceph-mon[102669]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:13.957 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:13 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:14.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:13 smithi186 ceph-mon[83629]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:14.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:13 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:14.921 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:19:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:19:14] "GET /metrics HTTP/1.1" 200 38773 "" "Prometheus/2.33.4" 2024-05-06T13:19:15.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:15.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[93192]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1017 B/s rd, 0 op/s 2024-05-06T13:19:15.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[93192]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:15.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[102669]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1017 B/s rd, 0 op/s 2024-05-06T13:19:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[102669]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:15.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:14 smithi186 ceph-mon[83629]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1017 B/s rd, 0 op/s 2024-05-06T13:19:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:14 smithi186 ceph-mon[83629]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:15.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[93192]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[93192]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 840 B/s rd, 0 op/s 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[93192]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.245 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[102669]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:17.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[102669]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 840 B/s rd, 0 op/s 2024-05-06T13:19:17.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[102669]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:17.246 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:16 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:16 smithi186 ceph-mon[83629]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:16 smithi186 ceph-mon[83629]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 840 B/s rd, 0 op/s 2024-05-06T13:19:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:16 smithi186 ceph-mon[83629]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:17.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:16 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:18.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:17 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:18.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:17 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:18.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:17 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:19.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:18 smithi186 ceph-mon[83629]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:19.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:18 smithi016 ceph-mon[93192]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:19.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:18 smithi016 ceph-mon[102669]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.424 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: Adjusting osd_memory_target on smithi186 to 2736M 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.425 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: Adjusting osd_memory_target on smithi186 to 2736M 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.426 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:20 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: Adjusting osd_memory_target on smithi186 to 2736M 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:20.516 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:20 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:21.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:21 smithi016 ceph-mon[93192]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:19:21.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:21 smithi016 ceph-mon[102669]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:19:21.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:21 smithi186 ceph-mon[83629]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-06T13:19:22.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:22 smithi016 ceph-mon[93192]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-05-06T13:19:22.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:22 smithi016 ceph-mon[102669]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-05-06T13:19:22.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:22 smithi186 ceph-mon[83629]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-05-06T13:19:24.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:24 smithi016 ceph-mon[93192]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-05-06T13:19:24.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:24 smithi016 ceph-mon[102669]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-05-06T13:19:24.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:24 smithi186 ceph-mon[83629]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-05-06T13:19:25.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:19:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:19:24] "GET /metrics HTTP/1.1" 200 38774 "" "Prometheus/2.33.4" 2024-05-06T13:19:26.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:26 smithi186 ceph-mon[83629]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:19:26.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:26 smithi016 ceph-mon[93192]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:19:26.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:26 smithi016 ceph-mon[102669]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-06T13:19:28.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:28 smithi016 ceph-mon[93192]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 918 B/s rd, 0 op/s 2024-05-06T13:19:28.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:28 smithi016 ceph-mon[102669]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 918 B/s rd, 0 op/s 2024-05-06T13:19:28.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:28 smithi186 ceph-mon[83629]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 918 B/s rd, 0 op/s 2024-05-06T13:19:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:30 smithi016 ceph-mon[102669]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:19:30.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:30 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:30 smithi016 ceph-mon[93192]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:19:30.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:30 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:30.447 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:30 smithi186 ceph-mon[83629]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-06T13:19:30.447 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:30 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:32.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:32 smithi186 ceph-mon[83629]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:32.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:32 smithi016 ceph-mon[93192]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:32.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:32 smithi016 ceph-mon[102669]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:33 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:34.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:33 smithi016 ceph-mon[93192]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:34.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:33 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:34.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:34.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:33 smithi016 ceph-mon[102669]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:33 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:34.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:33 smithi186 ceph-mon[83629]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:35.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:19:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:19:34] "GET /metrics HTTP/1.1" 200 38776 "" "Prometheus/2.33.4" 2024-05-06T13:19:35.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.335 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.336 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:35.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:36.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:36 smithi016 ceph-mon[93192]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:36.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:36 smithi016 ceph-mon[102669]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:36.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:36 smithi186 ceph-mon[83629]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:38.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:38 smithi016 ceph-mon[93192]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:38.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:38 smithi016 ceph-mon[102669]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:38.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:38 smithi186 ceph-mon[83629]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:40.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:40 smithi016 ceph-mon[93192]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:40.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:40 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:40.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:40 smithi016 ceph-mon[102669]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:40.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:40 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:40.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:40 smithi186 ceph-mon[83629]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:40.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:40 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:42 smithi186 ceph-mon[83629]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:42.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:42 smithi016 ceph-mon[93192]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:42.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:42 smithi016 ceph-mon[102669]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:44.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:44 smithi016 ceph-mon[93192]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:44.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:44 smithi016 ceph-mon[102669]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:44.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:44 smithi186 ceph-mon[83629]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:45.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:19:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:19:44] "GET /metrics HTTP/1.1" 200 38776 "" "Prometheus/2.33.4" 2024-05-06T13:19:46.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:46 smithi016 ceph-mon[93192]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:46.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:46 smithi016 ceph-mon[102669]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:46.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:46 smithi186 ceph-mon[83629]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:48.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:48 smithi016 ceph-mon[93192]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:48.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:48.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:48 smithi016 ceph-mon[102669]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:48.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:48.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:48 smithi186 ceph-mon[83629]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:48.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:19:50.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:50 smithi016 ceph-mon[93192]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:50.423 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:50 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:50.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:50 smithi016 ceph-mon[102669]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:50.424 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:50 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:50.445 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:50 smithi186 ceph-mon[83629]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:50.445 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:50 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:19:52.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:52 smithi186 ceph-mon[83629]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:52.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:52 smithi016 ceph-mon[93192]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:52.673 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:52 smithi016 ceph-mon[102669]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:54.492 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:54 smithi016 ceph-mon[93192]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:54.492 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:54 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:54.493 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:54 smithi016 ceph-mon[102669]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:54.493 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:54 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:54.514 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:54 smithi186 ceph-mon[83629]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:19:54.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:54 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:19:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:19:54] "GET /metrics HTTP/1.1" 200 38775 "" "Prometheus/2.33.4" 2024-05-06T13:19:55.452 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.453 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:55 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:55.515 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:55 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:19:56.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:56 smithi186 ceph-mon[83629]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:56.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:56 smithi016 ceph-mon[93192]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:56.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:56 smithi016 ceph-mon[102669]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:19:58.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:19:58 smithi186 ceph-mon[83629]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:58.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:19:58 smithi016 ceph-mon[93192]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:19:58.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:19:58 smithi016 ceph-mon[102669]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-06T13:20:00.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Health detail: HEALTH_WARN Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:00.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Upgrade daemon: iscsi.foo.smithi016.oxwhiv: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:20:00.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Creating ceph-iscsi config... 2024-05-06T13:20:00.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:20:00.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:20:00.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dc6d11770\x2d0ba7\x2d11ef\x2dbc97\x2dc7b262605968.slice/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service 2024-05-06T13:20:00.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Non-zero exit code 1 from systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:20:00.767 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: Traceback (most recent call last): 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: return _run_code(code, main_globals, None, 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: exec(code, run_globals) 2024-05-06T13:20:00.768 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:20:00.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:20:00.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:20:00.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:20:00.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:20:00.769 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1087, in deploy_daemon 2024-05-06T13:20:00.770 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1223, in deploy_daemon_units 2024-05-06T13:20:00.770 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:20:00.770 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: RuntimeError: Failed command: systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:00.770 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:00 smithi186 ceph-mon[83629]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:00.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Health detail: HEALTH_WARN Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Upgrade daemon: iscsi.foo.smithi016.oxwhiv: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Creating ceph-iscsi config... 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:20:00.924 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dc6d11770\x2d0ba7\x2d11ef\x2dbc97\x2dc7b262605968.slice/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Non-zero exit code 1 from systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: Traceback (most recent call last): 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: return _run_code(code, main_globals, None, 2024-05-06T13:20:00.925 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: exec(code, run_globals) 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:20:00.926 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1087, in deploy_daemon 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1223, in deploy_daemon_units 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: RuntimeError: Failed command: systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[93192]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Health detail: HEALTH_WARN Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:00.927 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Upgrade daemon: iscsi.foo.smithi016.oxwhiv: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Creating ceph-iscsi config... 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dc6d11770\x2d0ba7\x2d11ef\x2dbc97\x2dc7b262605968.slice/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Non-zero exit code 1 from systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:00.928 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: Traceback (most recent call last): 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: return _run_code(code, main_globals, None, 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: exec(code, run_globals) 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1087, in deploy_daemon 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1223, in deploy_daemon_units 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:20:00.929 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: RuntimeError: Failed command: systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:00.930 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:00 smithi016 ceph-mon[102669]: See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:02.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:02 smithi186 ceph-mon[83629]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:02.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:02 smithi016 ceph-mon[93192]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:02.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:02 smithi016 ceph-mon[102669]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:03.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:03 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:03.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:03 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:03.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:03 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:04.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:04 smithi186 ceph-mon[83629]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:04.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:04 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:20:04] "GET /metrics HTTP/1.1" 200 38775 "" "Prometheus/2.33.4" 2024-05-06T13:20:04.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:04 smithi016 ceph-mon[93192]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:04.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:04 smithi016 ceph-mon[102669]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:06.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:06 smithi186 ceph-mon[83629]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:06.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:06 smithi016 ceph-mon[93192]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:06.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:06 smithi016 ceph-mon[102669]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:08.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:08 smithi186 ceph-mon[83629]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:08.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:08 smithi016 ceph-mon[93192]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:08.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:08 smithi016 ceph-mon[102669]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:10.689 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:10 smithi186 ceph-mon[83629]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:10.690 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:10 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:10.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:10 smithi016 ceph-mon[93192]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:10.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:10 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:10.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:10 smithi016 ceph-mon[102669]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:10.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:10 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:12.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:12 smithi016 ceph-mon[93192]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:12.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:12 smithi016 ceph-mon[102669]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:13.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:12 smithi186 ceph-mon[83629]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:14.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:14 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:20:14] "GET /metrics HTTP/1.1" 200 38775 "" "Prometheus/2.33.4" 2024-05-06T13:20:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:14 smithi186 ceph-mon[83629]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.766 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:14 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[93192]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[102669]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:14.826 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:14 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:15.920 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:15.920 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:15.921 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:15 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:15.921 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:15.921 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:15.921 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:15 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:16.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:16.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:16.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:15 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:16.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch ps' 2024-05-06T13:20:16.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:16 smithi016 ceph-mon[93192]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:16.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:16 smithi016 ceph-mon[102669]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:17.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:16 smithi186 ceph-mon[83629]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:18.718 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:18 smithi016 ceph-mon[93192]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:18.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:18 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:18.719 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:18 smithi016 ceph-mon[102669]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:18.719 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:18 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:18 smithi186 ceph-mon[83629]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:19.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:18 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi016 smithi016 running 4s ago 24m - - 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:agent.smithi186 smithi186 running 4s ago 23m - - 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.a smithi016 *:9093,9094 running (14m) 4s ago 18m - - 0.23.0 ba2b418f427c 8f4cd930f229 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.a smithi186 *:3000 running (13m) 4s ago 18m 54.1M - 8.3.5 dad864ee21e9 d39e22935d87 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:iscsi.foo.smithi016.oxwhiv smithi016 running (79s) 4s ago 17m - - 3.7 e4ce8ad5d0c4 da981c695247 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.x smithi186 *:8443,9283,8765 running (13m) 4s ago 23m 546M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 de55246538ea 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.y smithi016 *:8443,9283,8765 running (11m) 4s ago 25m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 2613b45a779c 2024-05-06T13:20:19.077 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a smithi016 running (11m) 4s ago 25m - 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 66a971db8a66 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b smithi186 running (10m) 4s ago 23m 65.4M 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 320fce626ef7 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c smithi016 running (10m) 4s ago 23m - 2048M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 d76a93ae9945 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.a smithi016 *:9100 running (14m) 4s ago 19m - - 1.3.1 1dbe0e931976 0518d3fd4e1e 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.b smithi186 *:9100 running (13m) 4s ago 19m 17.8M - 1.3.1 1dbe0e931976 a99fb73bfffd 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (8m) 4s ago 22m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 3734066d857e 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (8m) 4s ago 22m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f2947004d30f 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (7m) 4s ago 22m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 0a411c69a28f 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi016 running (6m) 4s ago 21m - 2481M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 dcd5dce3b9c0 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi186 running (5m) 4s ago 21m 60.2M 2736M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 1ad9e4ff86b2 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi186 running (4m) 4s ago 21m 62.1M 2736M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ad5bb11e9c71 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 smithi186 running (3m) 4s ago 20m 50.5M 2736M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 ce2aaac07e20 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 smithi186 running (3m) 4s ago 20m 52.2M 2736M 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 208a025316fc 2024-05-06T13:20:19.078 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.a smithi186 *:9095 running (12m) 4s ago 19m 71.0M - 2.33.4 514e6a882f6e 2679b06be937 2024-05-06T13:20:19.079 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi016.pgdorv smithi016 *:8000 running (2m) 4s ago 17m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 67d50c896ef3 2024-05-06T13:20:19.079 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.foo.smithi186.wuvklh smithi186 *:8000 running (2m) 4s ago 17m 75.2M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 f65362386d05 2024-05-06T13:20:19.079 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi016.rbmnkc smithi016 *:80 running (2m) 4s ago 17m - - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 827ac11ab93a 2024-05-06T13:20:19.079 INFO:teuthology.orchestra.run.smithi016.stdout:rgw.smpl.smithi186.dsrbux smithi186 *:80 running (115s) 4s ago 17m 75.2M - 19.0.0-2498-g70ce9539 e4ce8ad5d0c4 46d4a4d10bed 2024-05-06T13:20:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:20:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:19 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:20:19.673 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:19 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:19.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:20:19.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:19 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:20:19.674 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:19 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:19.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph versions' 2024-05-06T13:20:20.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-06T13:20:20.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:19 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-06T13:20:20.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:19 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:20.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:20 smithi016 ceph-mon[93192]: from='client.65002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:20.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:20 smithi016 ceph-mon[93192]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:20.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:20 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:20.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:20 smithi016 ceph-mon[102669]: from='client.65002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:20.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:20 smithi016 ceph-mon[102669]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:20.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:20 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:21.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:20 smithi186 ceph-mon[83629]: from='client.65002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:21.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:20 smithi186 ceph-mon[83629]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:21.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:20 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:21.799 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:20:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-05-06T13:20:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 3 2024-05-06T13:20:21.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 2 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 8 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw": { 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 4 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)": 17 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-06T13:20:21.800 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:20:22.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch upgrade status' 2024-05-06T13:20:22.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:22 smithi016 ceph-mon[93192]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:22.878 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:22 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/3754613255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:22.878 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:22 smithi016 ceph-mon[102669]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:22.878 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:22 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/3754613255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:23.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:22 smithi186 ceph-mon[83629]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:23.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:22 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/3754613255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa", 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw", 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "iscsi", 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-05-06T13:20:24.696 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-05-06T13:20:24.697 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-05-06T13:20:24.697 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-05-06T13:20:24.697 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "18/23 daemons upgraded", 2024-05-06T13:20:24.697 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed.", 2024-05-06T13:20:24.697 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": true 2024-05-06T13:20:24.697 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:20:24.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:24 smithi016 ceph-mon[93192]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:24.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:24 smithi016 ceph-mon[102669]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:25.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:24 smithi186 ceph-mon[83629]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:25.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:20:24] "GET /metrics HTTP/1.1" 200 38776 "" "Prometheus/2.33.4" 2024-05-06T13:20:25.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph health detail' 2024-05-06T13:20:25.648 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:25 smithi016 ceph-mon[93192]: from='client.45108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:25.907 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:25 smithi016 ceph-mon[102669]: from='client.45108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:26.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:25 smithi186 ceph-mon[83629]: from='client.45108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:26.908 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:26 smithi016 ceph-mon[93192]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:26.908 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:26 smithi016 ceph-mon[102669]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:27.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:26 smithi186 ceph-mon[83629]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:27.441 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi016.oxwhiv on host smithi016 failed. 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrade daemon: iscsi.foo.smithi016.oxwhiv: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi016.oxwhiv ... 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Creating ceph-iscsi config... 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/iscsi-gateway.cfg 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Write file: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/iscsi.foo.smithi016.oxwhiv/tcmu-runner-entrypoint.sh 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dc6d11770\x2d0ba7\x2d11ef\x2dbc97\x2dc7b262605968.slice/ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Traceback (most recent call last): 2024-05-06T13:20:27.442 INFO:teuthology.orchestra.run.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: return _run_code(code, main_globals, None, 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: exec(code, run_globals) 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5618, in 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 5606, in main 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3096, in command_deploy_from 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3131, in _common_deploy 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 3151, in _deploy_daemon_container 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1087, in deploy_daemon 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/__main__.py", line 1223, in deploy_daemon_units 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout: File "/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/cephadm.1beb51c47e1829c362cd9b19cf8a7b999ad8bbb9ab73d24fbfffb07828920cba/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout:RuntimeError: Failed command: systemctl start ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv: Job for ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service failed because the control process exited with error code. 2024-05-06T13:20:27.443 INFO:teuthology.orchestra.run.smithi016.stdout:See "systemctl status ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" and "journalctl -xeu ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@iscsi.foo.smithi016.oxwhiv.service" for details. 2024-05-06T13:20:27.750 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:27 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/2542042731' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:20:27.751 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:27 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/2542042731' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:20:28.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:27 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/2542042731' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-06T13:20:28.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-05-06T13:20:28.738 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:28 smithi016 ceph-mon[93192]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:28.738 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:28 smithi016 ceph-mon[102669]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:29.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:28 smithi186 ceph-mon[83629]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:30.106 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-05-06T13:20:30.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:30 smithi186 ceph-mon[83629]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:30.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:30 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:30.696 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:30 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/1342247716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:30.773 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:30 smithi016 ceph-mon[93192]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:30.773 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:30 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:30.773 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:30 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/1342247716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:30.773 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:30 smithi016 ceph-mon[102669]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:30.773 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:30 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:30.774 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:30 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/1342247716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:30.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-05-06T13:20:32.898 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.0.0-2498-g70ce9539 (70ce9539b62a15b9de429c1f0e91a1e012b099aa) squid (dev)" 2024-05-06T13:20:32.898 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:32 smithi016 ceph-mon[93192]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:32.899 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:32 smithi016 ceph-mon[102669]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:33.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:32 smithi186 ceph-mon[83629]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:33.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-05-06T13:20:33.862 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:33 smithi016 ceph-mon[93192]: from='client.? 172.21.15.16:0/4238517737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:33.862 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:33 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:33.862 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:33 smithi016 ceph-mon[102669]: from='client.? 172.21.15.16:0/4238517737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:33.862 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:33 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:33 smithi186 ceph-mon[83629]: from='client.? 172.21.15.16:0/4238517737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-06T13:20:34.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:33 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:34.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:20:34] "GET /metrics HTTP/1.1" 200 38764 "" "Prometheus/2.33.4" 2024-05-06T13:20:34.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:34 smithi186 ceph-mon[83629]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:34.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.765 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:34 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[93192]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:34.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.820 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.820 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[102669]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:34.820 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.821 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:34.821 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:34 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:35.572 INFO:teuthology.orchestra.run.smithi016.stdout:osd 8 1s ago - 2024-05-06T13:20:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:35 smithi186 ceph-mon[83629]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:35 smithi016 ceph-mon[93192]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.173 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.174 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:35 smithi016 ceph-mon[102669]: from='mgr.35384 ' entity='mgr.x' 2024-05-06T13:20:36.629 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-06T13:20:36.641 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi016.front.sepia.ceph.com 2024-05-06T13:20:36.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- bash -c 'ceph orch upgrade ls' 2024-05-06T13:20:36.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:36 smithi016 ceph-mon[93192]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:36.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:36 smithi016 ceph-mon[93192]: from='client.45132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:36.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:36 smithi016 ceph-mon[102669]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:36.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:36 smithi016 ceph-mon[102669]: from='client.45132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:37.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:36 smithi186 ceph-mon[83629]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:37.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:36 smithi186 ceph-mon[83629]: from='client.45132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:38.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:38 smithi016 ceph-mon[93192]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:38.924 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:38 smithi016 ceph-mon[102669]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:39.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:38 smithi186 ceph-mon[83629]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:40.784 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-06T13:20:40.785 INFO:teuthology.orchestra.run.smithi016.stdout: "image": "quay.io/ceph/ceph", 2024-05-06T13:20:40.785 INFO:teuthology.orchestra.run.smithi016.stdout: "registry": "quay.io", 2024-05-06T13:20:40.785 INFO:teuthology.orchestra.run.smithi016.stdout: "bare_image": "ceph/ceph", 2024-05-06T13:20:40.785 INFO:teuthology.orchestra.run.smithi016.stdout: "versions": [] 2024-05-06T13:20:40.785 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-06T13:20:40.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:40 smithi016 ceph-mon[93192]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:40.923 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:40 smithi016 ceph-mon[93192]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:40.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:40 smithi016 ceph-mon[102669]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:40.923 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:40 smithi016 ceph-mon[102669]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:40 smithi186 ceph-mon[83629]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:41.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:40 smithi186 ceph-mon[83629]: from='client.64963 -' entity='client.iscsi.foo.smithi016.oxwhiv' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-06T13:20:41.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0' 2024-05-06T13:20:42.051 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:41 smithi016 ceph-mon[102669]: from='client.45138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:42.051 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:41 smithi016 ceph-mon[93192]: from='client.45138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:42.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:41 smithi186 ceph-mon[83629]: from='client.45138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:43.067 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:42 smithi016 ceph-mon[93192]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:43.067 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:42 smithi016 ceph-mon[102669]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:43.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:42 smithi186 ceph-mon[83629]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:44.789 INFO:teuthology.orchestra.run.smithi016.stdout: "16.2.0", 2024-05-06T13:20:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:44 smithi186 ceph-mon[83629]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:45.015 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:44 smithi186 ceph-mon[83629]: from='client.65050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:45.015 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:20:44] "GET /metrics HTTP/1.1" 200 38764 "" "Prometheus/2.33.4" 2024-05-06T13:20:45.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:44 smithi016 ceph-mon[93192]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:45.078 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:44 smithi016 ceph-mon[93192]: from='client.65050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:44 smithi016 ceph-mon[102669]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:45.079 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:44 smithi016 ceph-mon[102669]: from='client.65050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:45.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-05-06T13:20:47.041 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:46 smithi016 ceph-mon[93192]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:47.042 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:46 smithi016 ceph-mon[102669]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:47.264 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:46 smithi186 ceph-mon[83629]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-06T13:20:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "v16.2.2", 2024-05-06T13:20:48.805 INFO:teuthology.orchestra.run.smithi016.stdout: "v16.2.2-20210505", 2024-05-06T13:20:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:48 smithi016 ceph-mon[93192]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:48 smithi016 ceph-mon[93192]: from='client.45150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:49.127 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:48 smithi016 ceph-mon[93192]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:48 smithi016 ceph-mon[102669]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:48 smithi016 ceph-mon[102669]: from='client.45150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:49.128 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:48 smithi016 ceph-mon[102669]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:48 smithi186 ceph-mon[83629]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 296 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-06T13:20:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:48 smithi186 ceph-mon[83629]: from='client.45150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-06T13:20:49.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:48 smithi186 ceph-mon[83629]: from='mgr.35384 172.21.15.186:0/3290018182' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-06T13:20:49.466 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-06T13:20:49.476 INFO:tasks.cephadm:Teardown begin 2024-05-06T13:20:49.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:20:49.508 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:20:49.539 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-06T13:20:49.539 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-06T13:20:49.564 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-06T13:20:49.595 INFO:tasks.cephadm:Stopping all daemons... 2024-05-06T13:20:49.595 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-06T13:20:49.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a 2024-05-06T13:20:49.743 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:49 smithi016 systemd[1]: Stopping Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:20:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a[93175]: 2024-05-06T13:20:49.914+0000 7fc4a03eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:20:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:49 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a[93175]: 2024-05-06T13:20:49.914+0000 7fc4a03eb700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-05-06T13:20:50.173 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:49 smithi016 podman[189163]: 2024-05-06 13:20:49.935623397 +0000 UTC m=+0.134114068 container died 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-05-06T13:20:50.448 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:50 smithi016 podman[189163]: 2024-05-06 13:20:50.264350262 +0000 UTC m=+0.462840927 container cleanup 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, org.label-schema.license=GPLv2) 2024-05-06T13:20:50.448 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:50 smithi016 bash[189163]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a 2024-05-06T13:20:50.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service' 2024-05-06T13:20:50.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:50 smithi016 podman[189177]: 2024-05-06 13:20:50.449049005 +0000 UTC m=+0.509482887 container remove 66a971db8a661d1218309ce3d68ff445f190d16e15db5943a169ba57624a0f01 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-a, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-06T13:20:50.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:50 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-06T13:20:50.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:50 smithi016 systemd[1]: Stopped Ceph mon.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:20:50.719 INFO:journalctl@ceph.mon.a.smithi016.stdout:May 06 13:20:50 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.a.service: Consumed 23.001s CPU time. 2024-05-06T13:20:50.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:20:50.756 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-06T13:20:50.756 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-05-06T13:20:50.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c 2024-05-06T13:20:51.093 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:50 smithi016 systemd[1]: Stopping Ceph mon.c for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:20:51.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c[102665]: 2024-05-06T13:20:51.093+0000 7fd3c9501700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:20:51.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:51 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c[102665]: 2024-05-06T13:20:51.093+0000 7fd3c9501700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-05-06T13:20:51.423 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:51 smithi016 podman[189285]: 2024-05-06 13:20:51.124498205 +0000 UTC m=+0.140410534 container died d76a93ae994572ffc9020fba71373053d5c6d4a23a7c0f51a2db6f20616015c7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:20:51] ENGINE Bus STOPPING 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:20:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:20:51] ENGINE Bus STOPPED 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:20:51] ENGINE Bus STARTING 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: CherryPy Checker: 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: The Application mounted at '' has an empty config. 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:20:51.515 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:20:51] ENGINE Serving on http://:::9283 2024-05-06T13:20:51.516 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: [06/May/2024:13:20:51] ENGINE Bus STARTED 2024-05-06T13:20:51.744 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:51 smithi016 podman[189285]: 2024-05-06 13:20:51.510402669 +0000 UTC m=+0.526315003 container cleanup d76a93ae994572ffc9020fba71373053d5c6d4a23a7c0f51a2db6f20616015c7 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-70ce953) 2024-05-06T13:20:51.744 INFO:journalctl@ceph.mon.c.smithi016.stdout:May 06 13:20:51 smithi016 bash[189285]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-c 2024-05-06T13:20:51.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.c.service' 2024-05-06T13:20:51.923 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:20:51.923 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-05-06T13:20:51.923 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-05-06T13:20:51.923 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.b 2024-05-06T13:20:52.265 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:51 smithi186 systemd[1]: Stopping Ceph mon.b for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:20:52.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b[83625]: 2024-05-06T13:20:52.746+0000 7fee1ce28700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:20:52.838 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b[83625]: 2024-05-06T13:20:52.746+0000 7fee1ce28700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-05-06T13:20:53.115 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:52 smithi186 podman[163399]: 2024-05-06 13:20:52.838931667 +0000 UTC m=+0.195045377 container died 320fce626ef76ed9a5e06cac18b5b95bbb00d0c8a7c87509c95c7155961be950 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-05-06T13:20:53.498 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:53 smithi186 podman[163399]: 2024-05-06 13:20:53.214171484 +0000 UTC m=+0.570285191 container cleanup 320fce626ef76ed9a5e06cac18b5b95bbb00d0c8a7c87509c95c7155961be950 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-06T13:20:53.498 INFO:journalctl@ceph.mon.b.smithi186.stdout:May 06 13:20:53 smithi186 bash[163399]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mon-b 2024-05-06T13:20:53.638 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mon.b.service' 2024-05-06T13:20:53.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:20:53.691 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-05-06T13:20:53.691 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-06T13:20:53.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y 2024-05-06T13:20:54.061 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:20:53 smithi016 systemd[1]: Stopping Ceph mgr.y for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:20:54.405 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:20:54 smithi016 podman[189405]: 2024-05-06 13:20:54.062758167 +0000 UTC m=+0.171761641 container died 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, RELEASE=squid-70ce953, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-06T13:20:54.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:20:54 smithi016 podman[189405]: 2024-05-06 13:20:54.406703088 +0000 UTC m=+0.515706550 container cleanup 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-06T13:20:54.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:20:54 smithi016 bash[189405]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y 2024-05-06T13:20:54.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:20:54 smithi016 podman[189419]: 2024-05-06 13:20:54.583139723 +0000 UTC m=+0.516674545 container remove 2613b45a779c4cd762f4416fe4417d7a407ea6fb03ea5bce0de0cbb32f789984 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-y, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-06T13:20:54.673 INFO:journalctl@ceph.mgr.y.smithi016.stdout:May 06 13:20:54 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:20:54.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-06T13:20:54.876 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:20:54.876 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-06T13:20:54.876 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-06T13:20:54.876 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x 2024-05-06T13:20:54.898 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: ::ffff:172.21.15.186 - - [06/May/2024:13:20:54] "GET /metrics HTTP/1.1" 200 38774 "" "Prometheus/2.33.4" 2024-05-06T13:20:55.160 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:54 smithi186 systemd[1]: Stopping Ceph mgr.x for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:20:55.495 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:20:55.160+0000 7f9a6d3de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:20:55.495 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x[56655]: 2024-05-06T13:20:55.160+0000 7f9a6d3de700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-06T13:20:55.495 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:55 smithi186 podman[163544]: 2024-05-06 13:20:55.192115738 +0000 UTC m=+0.128933488 container died de55246538ea3506681a9eb79dc54745d36c6aefaf3352832c3d9e5281206047 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953) 2024-05-06T13:20:55.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:55 smithi186 podman[163544]: 2024-05-06 13:20:55.586420977 +0000 UTC m=+0.523238753 container cleanup de55246538ea3506681a9eb79dc54745d36c6aefaf3352832c3d9e5281206047 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-06T13:20:55.765 INFO:journalctl@ceph.mgr.x.smithi186.stdout:May 06 13:20:55 smithi186 bash[163544]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-mgr-x 2024-05-06T13:20:56.007 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-06T13:20:56.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:20:56.082 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-06T13:20:56.083 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-06T13:20:56.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0 2024-05-06T13:20:56.423 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:20:56 smithi016 systemd[1]: Stopping Ceph osd.0 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:20:57.718 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:20:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[113172]: 2024-05-06T13:20:57.553+0000 7f2320f10700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:20:57.718 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:20:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[113172]: 2024-05-06T13:20:57.553+0000 7f2320f10700 -1 osd.0 185 *** Got signal Terminated *** 2024-05-06T13:20:57.718 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:20:57 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0[113172]: 2024-05-06T13:20:57.553+0000 7f2320f10700 -1 osd.0 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:03.173 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:02 smithi016 podman[189585]: 2024-05-06 13:21:02.916965993 +0000 UTC m=+6.113928532 container died 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-06T13:21:03.494 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:03 smithi016 podman[189585]: 2024-05-06 13:21:03.474266358 +0000 UTC m=+6.671228903 container cleanup 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, RELEASE=squid-70ce953, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:21:03.494 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:03 smithi016 bash[189585]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0 2024-05-06T13:21:04.061 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:03 smithi016 podman[189679]: 2024-05-06 13:21:03.73398669 +0000 UTC m=+0.814585298 container remove 3734066d857e16482e2174a6911b90393fbc0b9872248708b9fdf8d46da04eaa (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0, RELEASE=squid-70ce953, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-06T13:21:04.311 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:04 smithi016 podman[189770]: 2024-05-06 13:21:03.964780649 +0000 UTC m=+0.018634070 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:04.311 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:04 smithi016 podman[189770]: 2024-05-06 13:21:04.093484428 +0000 UTC m=+0.147337836 container create 9cda500d949e951f8a8067555380b7986b74e24dfa49fb32b862703945166498 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True) 2024-05-06T13:21:04.312 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:04 smithi016 podman[189770]: 2024-05-06 13:21:04.312645454 +0000 UTC m=+0.366498863 container init 9cda500d949e951f8a8067555380b7986b74e24dfa49fb32b862703945166498 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-06T13:21:04.613 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:04 smithi016 podman[189770]: 2024-05-06 13:21:04.316057656 +0000 UTC m=+0.369911066 container start 9cda500d949e951f8a8067555380b7986b74e24dfa49fb32b862703945166498 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_CLEAN=True) 2024-05-06T13:21:04.613 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:04 smithi016 podman[189770]: 2024-05-06 13:21:04.412739616 +0000 UTC m=+0.466593040 container attach 9cda500d949e951f8a8067555380b7986b74e24dfa49fb32b862703945166498 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-06T13:21:04.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:May 06 13:21:04 smithi016 podman[189770]: 2024-05-06 13:21:04.614416271 +0000 UTC m=+0.668269686 container died 9cda500d949e951f8a8067555380b7986b74e24dfa49fb32b862703945166498 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-05-06T13:21:05.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.0.service' 2024-05-06T13:21:05.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:05.225 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-06T13:21:05.225 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-06T13:21:05.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1 2024-05-06T13:21:05.923 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:05 smithi016 systemd[1]: Stopping Ceph osd.1 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:05.923 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:05 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[126492]: 2024-05-06T13:21:05.760+0000 7f5e00b1a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:05.923 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:05 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[126492]: 2024-05-06T13:21:05.760+0000 7f5e00b1a700 -1 osd.1 185 *** Got signal Terminated *** 2024-05-06T13:21:05.923 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:05 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1[126492]: 2024-05-06T13:21:05.760+0000 7f5e00b1a700 -1 osd.1 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:11.420 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:11 smithi016 podman[189878]: 2024-05-06 13:21:11.169017136 +0000 UTC m=+5.505192833 container died f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-06T13:21:11.673 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:11 smithi016 podman[189878]: 2024-05-06 13:21:11.586358881 +0000 UTC m=+5.922534570 container cleanup f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-06T13:21:11.673 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:11 smithi016 bash[189878]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1 2024-05-06T13:21:12.173 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:11 smithi016 podman[190164]: 2024-05-06 13:21:11.821239784 +0000 UTC m=+0.655233023 container remove f2947004d30f18bdfc2a68778af7f768987e9ed57f56d47026a5fc2e207d49d6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:21:12.673 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:12 smithi016 podman[190333]: 2024-05-06 13:21:12.210939112 +0000 UTC m=+0.019793949 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:13.286 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:12 smithi016 podman[190333]: 2024-05-06 13:21:12.975637347 +0000 UTC m=+0.784492172 container create 9f51f4ce57e15fd2a6a3135169a9c05002629d5870bcac2ca15775fb343bc40a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-06T13:21:13.286 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:13 smithi016 podman[190333]: 2024-05-06 13:21:13.203323604 +0000 UTC m=+1.012178433 container init 9f51f4ce57e15fd2a6a3135169a9c05002629d5870bcac2ca15775fb343bc40a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, org.label-schema.vendor=CentOS) 2024-05-06T13:21:13.286 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:13 smithi016 podman[190333]: 2024-05-06 13:21:13.206501224 +0000 UTC m=+1.015356050 container start 9f51f4ce57e15fd2a6a3135169a9c05002629d5870bcac2ca15775fb343bc40a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:21:13.286 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:13 smithi016 podman[190333]: 2024-05-06 13:21:13.286386825 +0000 UTC m=+1.095241668 container attach 9f51f4ce57e15fd2a6a3135169a9c05002629d5870bcac2ca15775fb343bc40a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-70ce953, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-06T13:21:13.873 INFO:journalctl@ceph.osd.1.smithi016.stdout:May 06 13:21:13 smithi016 podman[190333]: 2024-05-06 13:21:13.609436931 +0000 UTC m=+1.418291782 container died 9f51f4ce57e15fd2a6a3135169a9c05002629d5870bcac2ca15775fb343bc40a (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-06T13:21:14.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.1.service' 2024-05-06T13:21:14.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:14.197 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-06T13:21:14.197 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-06T13:21:14.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.2 2024-05-06T13:21:14.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:14 smithi016 systemd[1]: Stopping Ceph osd.2 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:15.673 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:21:15.365+0000 7efe033a6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:15.673 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:21:15.365+0000 7efe033a6700 -1 osd.2 185 *** Got signal Terminated *** 2024-05-06T13:21:15.674 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:15 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2[132613]: 2024-05-06T13:21:15.365+0000 7efe033a6700 -1 osd.2 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:20.965 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:20 smithi016 podman[190678]: 2024-05-06 13:21:20.676681167 +0000 UTC m=+5.414975578 container died 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, GIT_CLEAN=True, ceph=True) 2024-05-06T13:21:21.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:20 smithi016 podman[190678]: 2024-05-06 13:21:20.966199422 +0000 UTC m=+5.704493825 container cleanup 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:21:21.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:20 smithi016 bash[190678]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2 2024-05-06T13:21:21.423 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:21 smithi016 podman[190890]: 2024-05-06 13:21:21.200958514 +0000 UTC m=+0.524527917 container remove 0a411c69a28f4e0b530a3cf2151e23bcf7388a85a9f5bb019473121398884fc9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-06T13:21:21.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:21 smithi016 podman[190981]: 2024-05-06 13:21:21.518588791 +0000 UTC m=+0.095121224 container create 516e18582089383ab7a5ae801edebb2364b1353355d701dacee5ce446a276ff9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-05-06T13:21:21.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:21 smithi016 podman[190981]: 2024-05-06 13:21:21.44198629 +0000 UTC m=+0.018518750 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:21.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:21 smithi016 podman[190981]: 2024-05-06 13:21:21.73816818 +0000 UTC m=+0.314700621 container init 516e18582089383ab7a5ae801edebb2364b1353355d701dacee5ce446a276ff9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-06T13:21:21.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:21 smithi016 podman[190981]: 2024-05-06 13:21:21.742096925 +0000 UTC m=+0.318629357 container start 516e18582089383ab7a5ae801edebb2364b1353355d701dacee5ce446a276ff9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-06T13:21:21.820 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:21 smithi016 podman[190981]: 2024-05-06 13:21:21.82089333 +0000 UTC m=+0.397425770 container attach 516e18582089383ab7a5ae801edebb2364b1353355d701dacee5ce446a276ff9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-06T13:21:22.173 INFO:journalctl@ceph.osd.2.smithi016.stdout:May 06 13:21:22 smithi016 podman[190981]: 2024-05-06 13:21:22.039841848 +0000 UTC m=+0.616374290 container died 516e18582089383ab7a5ae801edebb2364b1353355d701dacee5ce446a276ff9 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:21:22.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.2.service' 2024-05-06T13:21:22.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:22.642 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-06T13:21:22.642 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-06T13:21:22.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3 2024-05-06T13:21:22.923 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:22 smithi016 systemd[1]: Stopping Ceph osd.3 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:23.344 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:22.976+0000 7f752049f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:23.344 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:22.976+0000 7f752049f700 -1 osd.3 185 *** Got signal Terminated *** 2024-05-06T13:21:23.344 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:22 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:22.976+0000 7f752049f700 -1 osd.3 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:24.423 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:23 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:23.934+0000 7f7518a8b700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:58.551183+0000 front 2024-05-06T13:20:58.551105+0000 (oldest deadline 2024-05-06T13:21:23.251381+0000) 2024-05-06T13:21:24.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:24 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:24.243+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:25.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:24 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:24.911+0000 7f7518a8b700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:58.551183+0000 front 2024-05-06T13:20:58.551105+0000 (oldest deadline 2024-05-06T13:21:23.251381+0000) 2024-05-06T13:21:25.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:25.241+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:25.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:25 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:25.444+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:26.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:25 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:25.866+0000 7f7518a8b700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:58.551183+0000 front 2024-05-06T13:20:58.551105+0000 (oldest deadline 2024-05-06T13:21:23.251381+0000) 2024-05-06T13:21:26.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:26 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:26.237+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:26.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:26 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:26.415+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:27.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:26 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:26.571+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:27.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:26 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:26.817+0000 7f7518a8b700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:58.551183+0000 front 2024-05-06T13:20:58.551105+0000 (oldest deadline 2024-05-06T13:21:23.251381+0000) 2024-05-06T13:21:27.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:27.255+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:27.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:27.404+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:27.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:27.440+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:28.014 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:27 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:27.521+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:28.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:27 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3[143714]: 2024-05-06T13:21:27.851+0000 7f7518a8b700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:58.551183+0000 front 2024-05-06T13:20:58.551105+0000 (oldest deadline 2024-05-06T13:21:23.251381+0000) 2024-05-06T13:21:28.514 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:28.245+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:28.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:28.403+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:28.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:28.477+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:28.860 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:28 smithi016 podman[191086]: 2024-05-06 13:21:28.494461529 +0000 UTC m=+5.622912043 container died dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:21:29.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:28 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:28.518+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:29.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:28 smithi016 podman[191086]: 2024-05-06 13:21:28.860659129 +0000 UTC m=+5.989109661 container cleanup dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-06T13:21:29.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:28 smithi016 bash[191086]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3 2024-05-06T13:21:29.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191103]: 2024-05-06 13:21:29.086923223 +0000 UTC m=+0.593199233 container remove dcd5dce3b9c0c01541b8cd334886532ab08bf4fe5ce99dbe0bd2173bb3bf8eb8 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:21:29.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191197]: 2024-05-06 13:21:29.412994608 +0000 UTC m=+0.113912472 container create 1a25c1d9e6b98279c367c5e5731f2bb68579eeb6288af5bb080f6acb6719d3ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-06T13:21:29.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191197]: 2024-05-06 13:21:29.317216949 +0000 UTC m=+0.018134754 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:29.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191197]: 2024-05-06 13:21:29.623802457 +0000 UTC m=+0.324720255 container init 1a25c1d9e6b98279c367c5e5731f2bb68579eeb6288af5bb080f6acb6719d3ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=squid-70ce953) 2024-05-06T13:21:29.673 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191197]: 2024-05-06 13:21:29.626904547 +0000 UTC m=+0.327822348 container start 1a25c1d9e6b98279c367c5e5731f2bb68579eeb6288af5bb080f6acb6719d3ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-06T13:21:29.716 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:29.277+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:29.716 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:29.397+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:29.717 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:29.451+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:29.717 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:29 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:29.480+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:30.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191197]: 2024-05-06 13:21:29.707251577 +0000 UTC m=+0.408169387 container attach 1a25c1d9e6b98279c367c5e5731f2bb68579eeb6288af5bb080f6acb6719d3ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430) 2024-05-06T13:21:30.173 INFO:journalctl@ceph.osd.3.smithi016.stdout:May 06 13:21:29 smithi016 podman[191197]: 2024-05-06 13:21:29.944041974 +0000 UTC m=+0.644959779 container died 1a25c1d9e6b98279c367c5e5731f2bb68579eeb6288af5bb080f6acb6719d3ce (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=squid-70ce953, org.label-schema.license=GPLv2) 2024-05-06T13:21:30.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.3.service' 2024-05-06T13:21:30.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:30.662 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-06T13:21:30.662 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-06T13:21:30.662 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4 2024-05-06T13:21:30.691 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:30.306+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:30.692 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:30.422+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:30.692 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:30.475+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:30.693 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:30 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:30.471+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:30.985 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:30 smithi186 systemd[1]: Stopping Ceph osd.4 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:31.641 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:31.286+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:31.641 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:31.446+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:31.641 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:31.514+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:31.642 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:31.510+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:31.642 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:31.510+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:32.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:31.640+0000 7f6660e1b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:32.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:31.640+0000 7f6660e1b700 -1 osd.4 185 *** Got signal Terminated *** 2024-05-06T13:21:32.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:31 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:31.640+0000 7f6660e1b700 -1 osd.4 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:32.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:32.313+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:32.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:32.418+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:32.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:32.418+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:32.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:32.488+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:32.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:32.488+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:32.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:32.480+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:32.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:32 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:32.480+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:33.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:21:33.078Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.186:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.186:8765: connect: connection refused" 2024-05-06T13:21:33.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:21:33.087Z caller=refresh.go:98 level=error component="discovery manager notify" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.186:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.186:8765: connect: connection refused" 2024-05-06T13:21:33.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:21:33.087Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.186:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.186:8765: connect: connection refused" 2024-05-06T13:21:33.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:21:33.088Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.186:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.186:8765: connect: connection refused" 2024-05-06T13:21:33.265 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:21:33.090Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.186:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.186:8765: connect: connection refused" 2024-05-06T13:21:33.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:33.448+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:33.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:33.448+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:33.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:33.512+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:33.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:33.512+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:33.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:33.274+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:33.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:33.274+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:07.104341+0000 front 2024-05-06T13:21:07.104294+0000 (oldest deadline 2024-05-06T13:21:33.004067+0000) 2024-05-06T13:21:33.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:33.505+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:33.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:33 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:33.505+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:34.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:34.472+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:34.877 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:34.472+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:34.879 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:34.292+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:34.879 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:34.292+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:07.104341+0000 front 2024-05-06T13:21:07.104294+0000 (oldest deadline 2024-05-06T13:21:33.004067+0000) 2024-05-06T13:21:34.881 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:34.440+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:34.881 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:34.440+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:34.882 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:34.522+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:34.882 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:34 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:34.522+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:35.540 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:35.412+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:35.540 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:35.412+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:35.541 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:35.265+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:35.541 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:35.265+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:07.104341+0000 front 2024-05-06T13:21:07.104294+0000 (oldest deadline 2024-05-06T13:21:33.004067+0000) 2024-05-06T13:21:35.541 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:35.444+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:35.541 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:35.444+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:36.014 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:35.539+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:36.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:35 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:35.539+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:36.514 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:36.410+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:36.515 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:36.410+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:36.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:36.235+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:20:59.503399+0000 front 2024-05-06T13:20:59.503461+0000 (oldest deadline 2024-05-06T13:21:24.203301+0000) 2024-05-06T13:21:36.515 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4[112530]: 2024-05-06T13:21:36.235+0000 7f665d40f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:07.104341+0000 front 2024-05-06T13:21:07.104294+0000 (oldest deadline 2024-05-06T13:21:33.004067+0000) 2024-05-06T13:21:36.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:36.418+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:36.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:36.418+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:36.889 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:36.562+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:36.889 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:36 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:36.562+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:37.438 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:37 smithi186 podman[164480]: 2024-05-06 13:21:37.179426317 +0000 UTC m=+5.671814083 container died 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-06T13:21:37.438 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:37.419+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:37.438 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:37.419+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:37.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:37 smithi186 podman[164480]: 2024-05-06 13:21:37.607214755 +0000 UTC m=+6.099602562 container cleanup 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:21:37.765 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:37 smithi186 bash[164480]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4 2024-05-06T13:21:37.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:37.437+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:37.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:37.437+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:37.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:37.582+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:37.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:37 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:37.582+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:38.226 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:37 smithi186 podman[164879]: 2024-05-06 13:21:37.775457646 +0000 UTC m=+0.647779248 container remove 1ad9e4ff86b2a6fde6b945af199270539e03adfc70ddc3cb8cfa89e235c80747 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:21:38.477 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:38.399+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:38.477 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:38.399+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:38.477 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:38.455+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:38.477 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:38.455+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:38.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:38.540+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:38.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:38 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:38.540+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:39.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:39 smithi186 podman[165122]: 2024-05-06 13:21:39.091115371 +0000 UTC m=+0.348786989 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:39.265 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:39 smithi186 podman[165122]: 2024-05-06 13:21:39.215396015 +0000 UTC m=+0.473067675 container create 7cc91c15bd84b77b6d7100f134a8764335f9a7d7cba3603eb8ae5f0e004475ff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-06T13:21:39.609 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:39.478+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:39.609 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:39.478+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:39.610 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:39.377+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:39.610 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:39.377+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:39.610 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:39.574+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:39.610 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:39 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:39.574+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:39.610 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:39 smithi186 podman[165122]: 2024-05-06 13:21:39.426456021 +0000 UTC m=+0.684127639 container init 7cc91c15bd84b77b6d7100f134a8764335f9a7d7cba3603eb8ae5f0e004475ff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, GIT_CLEAN=True, ceph=True) 2024-05-06T13:21:39.611 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:39 smithi186 podman[165122]: 2024-05-06 13:21:39.42948782 +0000 UTC m=+0.687159440 container start 7cc91c15bd84b77b6d7100f134a8764335f9a7d7cba3603eb8ae5f0e004475ff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:21:39.611 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:39 smithi186 podman[165122]: 2024-05-06 13:21:39.526351275 +0000 UTC m=+0.784022894 container attach 7cc91c15bd84b77b6d7100f134a8764335f9a7d7cba3603eb8ae5f0e004475ff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-05-06T13:21:40.015 INFO:journalctl@ceph.osd.4.smithi186.stdout:May 06 13:21:39 smithi186 podman[165122]: 2024-05-06 13:21:39.822996942 +0000 UTC m=+1.080668553 container died 7cc91c15bd84b77b6d7100f134a8764335f9a7d7cba3603eb8ae5f0e004475ff (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-06T13:21:40.461 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.4.service' 2024-05-06T13:21:40.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:40.542 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-06T13:21:40.543 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-06T13:21:40.543 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5 2024-05-06T13:21:40.603 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:40.338+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:40.603 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:40.338+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:40.603 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:40.497+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:40.603 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:40.497+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:40.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:40.538+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:40.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:40 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:40.538+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:40.917 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:40 smithi186 systemd[1]: Stopping Ceph osd.5 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:41.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:41.300+0000 7f4a210d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:41.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:41.300+0000 7f4a210d0700 -1 osd.5 185 *** Got signal Terminated *** 2024-05-06T13:21:41.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:41.300+0000 7f4a210d0700 -1 osd.5 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:41.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:41.314+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:41.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:41.314+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:41.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:41.533+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:41.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:41.533+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:41.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:41.535+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:41.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:41 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:41.535+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:42.546 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:42.296+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:42.546 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:42.296+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:42.546 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:42.519+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:42.547 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:42.519+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:42.547 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:42.519+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:43.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:42.545+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:43.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:42 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:42.545+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:43.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:43.342+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:43.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:43.342+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:43.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:43.342+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:17.293821+0000 front 2024-05-06T13:21:17.293799+0000 (oldest deadline 2024-05-06T13:21:43.193651+0000) 2024-05-06T13:21:43.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:43.521+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:43.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:43.521+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:43.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:43.521+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:43.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:43.562+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:43.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:43.562+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:43.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:43 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:43.562+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:44.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:44.537+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:44.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:44.537+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:44.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:44.537+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:44.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:44.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:44.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:44.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:44.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:44.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:44.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:44.350+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:44.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:44.350+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:44.766 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:44 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:44.350+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:17.293821+0000 front 2024-05-06T13:21:17.293799+0000 (oldest deadline 2024-05-06T13:21:43.193651+0000) 2024-05-06T13:21:45.666 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:45.514+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:45.514+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:45.514+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:45.506+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:45.506+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:45.506+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:45.392+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.591172+0000 front 2024-05-06T13:21:01.591218+0000 (oldest deadline 2024-05-06T13:21:25.091169+0000) 2024-05-06T13:21:45.667 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:45.392+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:08.492769+0000 front 2024-05-06T13:21:08.492818+0000 (oldest deadline 2024-05-06T13:21:31.992645+0000) 2024-05-06T13:21:45.668 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:45 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5[124715]: 2024-05-06T13:21:45.392+0000 7f4a196bc700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:17.293821+0000 front 2024-05-06T13:21:17.293799+0000 (oldest deadline 2024-05-06T13:21:43.193651+0000) 2024-05-06T13:21:46.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:46.530+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:46.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:46.530+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:46.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:46.530+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:46.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:46.493+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:46.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:46.493+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:46.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:46.493+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:47.105 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:46 smithi186 podman[165332]: 2024-05-06 13:21:46.84316918 +0000 UTC m=+5.994919216 container died ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953) 2024-05-06T13:21:47.474 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:47 smithi186 podman[165332]: 2024-05-06 13:21:47.305628963 +0000 UTC m=+6.457378996 container cleanup ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0) 2024-05-06T13:21:47.474 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:47 smithi186 bash[165332]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5 2024-05-06T13:21:47.764 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:47 smithi186 podman[165411]: 2024-05-06 13:21:47.598791972 +0000 UTC m=+0.751452391 container remove ad5bb11e9c715db8565110d4ba0221d9be54daf0c4f8c2e5b02c6275e4f7e724 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-70ce953, org.label-schema.license=GPLv2) 2024-05-06T13:21:47.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:47.474+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:47.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:47.474+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:47.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:47.474+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:47.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:47.491+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:47.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:47.491+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:47.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:47 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:47.491+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:48.201 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:47 smithi186 podman[165512]: 2024-05-06 13:21:47.843171324 +0000 UTC m=+0.020583411 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:48.202 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:47 smithi186 podman[165512]: 2024-05-06 13:21:47.97488789 +0000 UTC m=+0.152299926 container create ec5afd87c059d258255fdf3663500eef66fb7cbeb7ae9bd3505c2d7da74f0001 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-06T13:21:48.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:48 smithi186 podman[165512]: 2024-05-06 13:21:48.202479035 +0000 UTC m=+0.379891077 container init ec5afd87c059d258255fdf3663500eef66fb7cbeb7ae9bd3505c2d7da74f0001 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240430) 2024-05-06T13:21:48.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:48 smithi186 podman[165512]: 2024-05-06 13:21:48.205793476 +0000 UTC m=+0.383205514 container start ec5afd87c059d258255fdf3663500eef66fb7cbeb7ae9bd3505c2d7da74f0001 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-06T13:21:48.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:48 smithi186 podman[165512]: 2024-05-06 13:21:48.285694838 +0000 UTC m=+0.463106886 container attach ec5afd87c059d258255fdf3663500eef66fb7cbeb7ae9bd3505c2d7da74f0001 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-06T13:21:48.765 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 06 13:21:48 smithi186 podman[165512]: 2024-05-06 13:21:48.503716107 +0000 UTC m=+0.681128135 container died ec5afd87c059d258255fdf3663500eef66fb7cbeb7ae9bd3505c2d7da74f0001 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-70ce953, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=) 2024-05-06T13:21:48.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:48.475+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:48.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:48.475+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:48.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:48.475+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:48.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:48.489+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:48.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:48.489+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:48.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:48 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:48.489+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:49.158 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.5.service' 2024-05-06T13:21:49.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:49.238 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-06T13:21:49.238 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-06T13:21:49.238 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6 2024-05-06T13:21:49.512 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 systemd[1]: Stopping Ceph osd.6 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:49.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:49.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:49.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.512+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.512+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.512+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:49.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.512+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.235960+0000 front 2024-05-06T13:21:26.235972+0000 (oldest deadline 2024-05-06T13:21:48.535890+0000) 2024-05-06T13:21:49.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.576+0000 7f5eabedc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:49.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.576+0000 7f5eabedc700 -1 osd.6 185 *** Got signal Terminated *** 2024-05-06T13:21:49.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:49 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:49.576+0000 7f5eabedc700 -1 osd.6 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:50.629 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:50.468+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:50.629 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:50.468+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:50.630 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:50.468+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:50.630 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:50.468+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.235960+0000 front 2024-05-06T13:21:26.235972+0000 (oldest deadline 2024-05-06T13:21:48.535890+0000) 2024-05-06T13:21:50.630 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:50.517+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:50.630 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:50.517+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:50.630 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:50 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:50.517+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:51.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:51.497+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:51.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:51.497+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:51.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:51.497+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:51.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:51.497+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.235960+0000 front 2024-05-06T13:21:26.235972+0000 (oldest deadline 2024-05-06T13:21:48.535890+0000) 2024-05-06T13:21:51.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:51.525+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:51.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:51.525+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:51.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:51 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:51.525+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:52.493+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:52.493+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:52.493+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:52.493+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.235960+0000 front 2024-05-06T13:21:26.235972+0000 (oldest deadline 2024-05-06T13:21:48.535890+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:52.566+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:52.566+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:52.566+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:52.765 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:52 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:52.566+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:21:54.015 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:53.515+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:54.015 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:53.515+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:54.015 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:53.515+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:54.015 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:53.515+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.235960+0000 front 2024-05-06T13:21:26.235972+0000 (oldest deadline 2024-05-06T13:21:48.535890+0000) 2024-05-06T13:21:54.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:53.533+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:54.016 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:53.533+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:54.016 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:53.533+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:54.016 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:53 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:53.533+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:21:54.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:54.479+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:01.832454+0000 front 2024-05-06T13:21:01.832319+0000 (oldest deadline 2024-05-06T13:21:27.132239+0000) 2024-05-06T13:21:54.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:54.479+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:10.033142+0000 front 2024-05-06T13:21:10.033086+0000 (oldest deadline 2024-05-06T13:21:31.733101+0000) 2024-05-06T13:21:54.765 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:54.479+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:16.934309+0000 front 2024-05-06T13:21:16.934322+0000 (oldest deadline 2024-05-06T13:21:41.634240+0000) 2024-05-06T13:21:54.766 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6[136842]: 2024-05-06T13:21:54.479+0000 7f5ea44c8700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.235960+0000 front 2024-05-06T13:21:26.235972+0000 (oldest deadline 2024-05-06T13:21:48.535890+0000) 2024-05-06T13:21:54.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:54.536+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:54.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:54.536+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:54.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:54.536+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:54.766 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:54 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:54.536+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:21:55.199 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:54 smithi186 podman[165620]: 2024-05-06 13:21:54.922386328 +0000 UTC m=+5.472046304 container died ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-06T13:21:55.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:55 smithi186 podman[165620]: 2024-05-06 13:21:55.290389066 +0000 UTC m=+5.840049044 container cleanup ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, RELEASE=squid-70ce953, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-06T13:21:55.515 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:55 smithi186 bash[165620]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6 2024-05-06T13:21:55.916 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:55 smithi186 podman[165750]: 2024-05-06 13:21:55.566724613 +0000 UTC m=+0.638369773 container remove ce2aaac07e2000ad9820b05eaba2ab7bbbf591a5f1b2b76dbfa93f0699986342 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-70ce953, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430) 2024-05-06T13:21:55.916 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:55.532+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:55.916 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:55.532+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:55.916 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:55.532+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:55.917 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:55 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:55.532+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:21:56.265 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:55 smithi186 podman[165837]: 2024-05-06 13:21:55.819382852 +0000 UTC m=+0.018227640 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:21:56.265 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:55 smithi186 podman[165837]: 2024-05-06 13:21:55.917438136 +0000 UTC m=+0.116282923 container create 74edd8782b12241dae030741d16fca8c023c1d6d4feb3dba7f9af3095be630b6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-06T13:21:56.535 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:56.535+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:56.535 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:56.535+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:56.536 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:56.535+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:56.536 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:56 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:56.535+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:21:56.536 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:56 smithi186 podman[165837]: 2024-05-06 13:21:56.286458101 +0000 UTC m=+0.485302894 container init 74edd8782b12241dae030741d16fca8c023c1d6d4feb3dba7f9af3095be630b6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-05-06T13:21:56.536 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:56 smithi186 podman[165837]: 2024-05-06 13:21:56.289678534 +0000 UTC m=+0.488523331 container start 74edd8782b12241dae030741d16fca8c023c1d6d4feb3dba7f9af3095be630b6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-70ce953) 2024-05-06T13:21:56.536 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:56 smithi186 podman[165837]: 2024-05-06 13:21:56.37003609 +0000 UTC m=+0.568880879 container attach 74edd8782b12241dae030741d16fca8c023c1d6d4feb3dba7f9af3095be630b6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-70ce953, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:21:56.872 INFO:journalctl@ceph.osd.6.smithi186.stdout:May 06 13:21:56 smithi186 podman[165837]: 2024-05-06 13:21:56.579870966 +0000 UTC m=+0.778715754 container died 74edd8782b12241dae030741d16fca8c023c1d6d4feb3dba7f9af3095be630b6 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=squid-70ce953, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-06T13:21:57.163 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.6.service' 2024-05-06T13:21:57.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:21:57.202 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-06T13:21:57.203 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-06T13:21:57.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.7 2024-05-06T13:21:57.514 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 systemd[1]: Stopping Ceph osd.7 for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:21:57.938 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.560+0000 7fda035e3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-06T13:21:57.938 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.560+0000 7fda035e3700 -1 osd.7 185 *** Got signal Terminated *** 2024-05-06T13:21:57.938 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.560+0000 7fda035e3700 -1 osd.7 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-06T13:21:57.938 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.572+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:57.938 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.572+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:57.939 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.572+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:57.939 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:57 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:57.572+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:21:58.537 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:58.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:21:59.014 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:58.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:21:59.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:58.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:21:59.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:58 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:58.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:22:00.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:59.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:22:00.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:59.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:22:00.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:59.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:22:00.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:59.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:22:00.015 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:21:59 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:21:59.537+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.186:6804 osd.4 since back 2024-05-06T13:21:36.414028+0000 front 2024-05-06T13:21:36.414042+0000 (oldest deadline 2024-05-06T13:21:59.314046+0000) 2024-05-06T13:22:00.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:00.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:22:00.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:00.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:22:00.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:00.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:22:00.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:00.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:22:00.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:00 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:00.543+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.186:6804 osd.4 since back 2024-05-06T13:21:36.414028+0000 front 2024-05-06T13:21:36.414042+0000 (oldest deadline 2024-05-06T13:21:59.314046+0000) 2024-05-06T13:22:01.707 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:01.507+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:22:01.707 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:01.507+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:22:01.707 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:01.507+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:22:01.707 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:01.507+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:22:01.707 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:01 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:01.507+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.186:6804 osd.4 since back 2024-05-06T13:21:36.414028+0000 front 2024-05-06T13:21:36.414042+0000 (oldest deadline 2024-05-06T13:21:59.314046+0000) 2024-05-06T13:22:02.955 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:02.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6804 osd.0 since back 2024-05-06T13:21:02.109273+0000 front 2024-05-06T13:21:02.109390+0000 (oldest deadline 2024-05-06T13:21:26.209170+0000) 2024-05-06T13:22:02.955 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:02.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6812 osd.1 since back 2024-05-06T13:21:09.010682+0000 front 2024-05-06T13:21:09.010711+0000 (oldest deadline 2024-05-06T13:21:31.310745+0000) 2024-05-06T13:22:02.955 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:02.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6820 osd.2 since back 2024-05-06T13:21:18.312051+0000 front 2024-05-06T13:21:18.312040+0000 (oldest deadline 2024-05-06T13:21:43.512666+0000) 2024-05-06T13:22:02.956 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:02.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.16:6828 osd.3 since back 2024-05-06T13:21:26.413586+0000 front 2024-05-06T13:21:26.413635+0000 (oldest deadline 2024-05-06T13:21:52.313435+0000) 2024-05-06T13:22:02.956 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:02 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7[142142]: 2024-05-06T13:22:02.516+0000 7fd9ffbd7700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.186:6804 osd.4 since back 2024-05-06T13:21:36.414028+0000 front 2024-05-06T13:21:36.414042+0000 (oldest deadline 2024-05-06T13:21:59.314046+0000) 2024-05-06T13:22:03.214 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:02 smithi186 podman[165946]: 2024-05-06 13:22:02.95616277 +0000 UTC m=+5.520093521 container died 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, RELEASE=squid-70ce953, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:22:03.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:03 smithi186 podman[165946]: 2024-05-06 13:22:03.390076987 +0000 UTC m=+5.954007781 container cleanup 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-70ce953) 2024-05-06T13:22:03.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:03 smithi186 bash[165946]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7 2024-05-06T13:22:03.959 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:03 smithi186 podman[166646]: 2024-05-06 13:22:03.666650539 +0000 UTC m=+0.712804306 container remove 208a025316fc28a129fa75f2ae965de1dae23b8731276d6a2a17e0243d0abd35 (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7, RELEASE=squid-70ce953, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-06T13:22:04.236 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:03 smithi186 podman[166738]: 2024-05-06 13:22:03.862814592 +0000 UTC m=+0.018129966 image pull e4ce8ad5d0c4b9ea60bc5f6b8b0fdb5efbe59bf7771fb0920fc2200e6ae546b0 quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa 2024-05-06T13:22:04.236 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:03 smithi186 podman[166738]: 2024-05-06 13:22:03.967214393 +0000 UTC m=+0.122529767 container create e73cb6f0d44d9de9790a655e903084057f7aee1849f0d7e7c11010130900f40f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-70ce953) 2024-05-06T13:22:04.236 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:04 smithi186 podman[166738]: 2024-05-06 13:22:04.236620315 +0000 UTC m=+0.391935691 container init e73cb6f0d44d9de9790a655e903084057f7aee1849f0d7e7c11010130900f40f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-06T13:22:04.514 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:04 smithi186 podman[166738]: 2024-05-06 13:22:04.240299824 +0000 UTC m=+0.395615199 container start e73cb6f0d44d9de9790a655e903084057f7aee1849f0d7e7c11010130900f40f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=squid-70ce953, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-06T13:22:04.515 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:04 smithi186 podman[166738]: 2024-05-06 13:22:04.319741017 +0000 UTC m=+0.475056413 container attach e73cb6f0d44d9de9790a655e903084057f7aee1849f0d7e7c11010130900f40f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-06T13:22:04.831 INFO:journalctl@ceph.osd.7.smithi186.stdout:May 06 13:22:04 smithi186 podman[166738]: 2024-05-06 13:22:04.538933944 +0000 UTC m=+0.694249328 container died e73cb6f0d44d9de9790a655e903084057f7aee1849f0d7e7c11010130900f40f (image=quay.ceph.io/ceph-ci/ceph:70ce9539b62a15b9de429c1f0e91a1e012b099aa, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-70ce953, org.label-schema.build-date=20240430) 2024-05-06T13:22:05.202 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@osd.7.service' 2024-05-06T13:22:05.246 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:22:05.246 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-06T13:22:05.246 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-05-06T13:22:05.246 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a 2024-05-06T13:22:05.436 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 systemd[1]: Stopping Ceph prometheus.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.426Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.426Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.426Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.426Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.426Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-06T13:22:05.437 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a[59235]: ts=2024-05-06T13:22:05.427Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-06T13:22:05.710 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 podman[166818]: 2024-05-06 13:22:05.436878591 +0000 UTC m=+0.106635787 container died 2679b06be93798e297e1cbc77ad5e46761480bc9567a61339d14712dc7f73c6b (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:06.014 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 podman[166818]: 2024-05-06 13:22:05.809915162 +0000 UTC m=+0.479672367 container cleanup 2679b06be93798e297e1cbc77ad5e46761480bc9567a61339d14712dc7f73c6b (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:06.014 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 bash[166818]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus-a 2024-05-06T13:22:06.015 INFO:journalctl@ceph.prometheus.a.smithi186.stdout:May 06 13:22:05 smithi186 bash[166853]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-prometheus.a" found: no such container 2024-05-06T13:22:06.073 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@prometheus.a.service' 2024-05-06T13:22:06.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-06T13:22:06.108 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-05-06T13:22:06.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-06T13:22:08.174 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:07 smithi016 systemd[1]: Stopping Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:22:08.174 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:07 smithi016 podman[192617]: 2024-05-06 13:22:07.98737242 +0000 UTC m=+0.103131417 container died 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:08.509 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 podman[192617]: 2024-05-06 13:22:08.32629963 +0000 UTC m=+0.442058614 container cleanup 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:08.510 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 bash[192617]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a 2024-05-06T13:22:08.863 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:08 smithi016 systemd[1]: Stopping Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:22:08.863 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 podman[192631]: 2024-05-06 13:22:08.510778577 +0000 UTC m=+0.527323827 container remove 0518d3fd4e1ebefa01127ef510e20a8a677f4e1647b3fb86b5afb72619ba7660 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:08.863 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:22:08.863 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 bash[192643]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter.a" found: no such container 2024-05-06T13:22:08.863 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-06T13:22:08.864 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 systemd[1]: Stopped Ceph node-exporter.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:22:08.864 INFO:journalctl@ceph.node-exporter.a.smithi016.stdout:May 06 13:22:08 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.a.service: Consumed 5.450s CPU time. 2024-05-06T13:22:09.141 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:08 smithi016 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a[61297]: level=info ts=2024-05-06T13:22:08.863Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-05-06T13:22:09.141 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:08 smithi016 podman[192699]: 2024-05-06 13:22:08.915117 +0000 UTC m=+0.159219489 container died 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:09.423 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 podman[192699]: 2024-05-06 13:22:09.233020184 +0000 UTC m=+0.477122664 container cleanup 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:09.423 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 bash[192699]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a 2024-05-06T13:22:09.423 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 podman[192713]: 2024-05-06 13:22:09.375726995 +0000 UTC m=+0.454038547 container remove 8f4cd930f229420fab8d6141feb2fce1c34a34642edfd8ade520c0c74598155b (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-06T13:22:09.704 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 podman[192713]: 2024-05-06 13:22:09.443024367 +0000 UTC m=+0.521335918 volume remove 1d0b9e34b575c937842cd70a83d59a32f904a8f28ad5b36e54cf2512873427ca 2024-05-06T13:22:09.704 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 bash[192725]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-alertmanager.a" found: no such container 2024-05-06T13:22:09.704 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-06T13:22:09.705 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 systemd[1]: Stopped Ceph alertmanager.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:22:09.705 INFO:journalctl@ceph.alertmanager.a.smithi016.stdout:May 06 13:22:09 smithi016 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@alertmanager.a.service: Consumed 1.460s CPU time. 2024-05-06T13:22:43.875 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-06T13:22:45.601 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:45 smithi186 systemd[1]: Stopping Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:22:45.999 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:45 smithi186 podman[168178]: 2024-05-06 13:22:45.601526168 +0000 UTC m=+0.109344647 container died a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:22:45.999 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:45 smithi186 podman[168178]: 2024-05-06 13:22:45.999668188 +0000 UTC m=+0.507486706 container cleanup a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:22:46.250 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:45 smithi186 bash[168178]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b 2024-05-06T13:22:46.250 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:46 smithi186 podman[168192]: 2024-05-06 13:22:46.234838275 +0000 UTC m=+0.637090737 container remove a99fb73bfffdce1884a6937cf4151b43f1e947e94a406c6f680636bf77a018c3 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-06T13:22:46.250 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:46 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-06T13:22:46.250 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:46 smithi186 bash[168205]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-node-exporter.b" found: no such container 2024-05-06T13:22:46.515 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:46 smithi186 systemd[1]: Stopping Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968... 2024-05-06T13:22:46.515 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:46 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-06T13:22:46.515 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:46 smithi186 systemd[1]: Stopped Ceph node-exporter.b for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:22:46.515 INFO:journalctl@ceph.node-exporter.b.smithi186.stdout:May 06 13:22:46 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@node-exporter.b.service: Consumed 5.107s CPU time. 2024-05-06T13:22:46.863 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:46 smithi186 ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a[52775]: t=2024-05-06T13:22:46+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-05-06T13:22:46.863 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:46 smithi186 podman[168257]: 2024-05-06 13:22:46.581807029 +0000 UTC m=+0.119514557 container died d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, name=ubi8, description=Ceph Grafana Container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8.5, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, build-date=2022-03-28T10:36:18.413762, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, vcs-type=git, distribution-scope=public, maintainer=Paul Cuzner , vendor=Red Hat, Inc., io.openshift.expose-services=, release=236.1648460182, summary=Grafana Container configured for Ceph mgr/dashboard integration) 2024-05-06T13:22:47.188 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:46 smithi186 podman[168257]: 2024-05-06 13:22:46.937579942 +0000 UTC m=+0.475287470 container cleanup d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, com.redhat.component=ubi8-container, release=236.1648460182, vcs-type=git, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, name=ubi8, description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, maintainer=Paul Cuzner , vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-06T13:22:47.188 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:46 smithi186 bash[168257]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a 2024-05-06T13:22:47.188 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:46 smithi186 bash[168285]: Error: no container with name or ID "ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana.a" found: no such container 2024-05-06T13:22:47.450 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:47 smithi186 podman[168271]: 2024-05-06 13:22:47.188667739 +0000 UTC m=+0.607040323 container remove d39e22935d87e1387ec056480b7cb28218afdbbed4b31b73f43c43ae7de4034e (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-c6d11770-0ba7-11ef-bc97-c7b262605968-grafana-a, io.openshift.tags=base rhel8, com.redhat.component=ubi8-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.24.2, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., version=8.5, name=ubi8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Paul Cuzner , release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, architecture=x86_64, distribution-scope=public) 2024-05-06T13:22:47.450 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:47 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-06T13:22:47.451 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:47 smithi186 systemd[1]: Stopped Ceph grafana.a for c6d11770-0ba7-11ef-bc97-c7b262605968. 2024-05-06T13:22:47.451 INFO:journalctl@ceph.grafana.a.smithi186.stdout:May 06 13:22:47 smithi186 systemd[1]: ceph-c6d11770-0ba7-11ef-bc97-c7b262605968@grafana.a.service: Consumed 5.672s CPU time. 2024-05-06T13:23:10.526 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:23:10.560 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-06T13:23:10.588 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-06T13:23:10.590 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/remote/smithi016/crash 2024-05-06T13:23:10.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/crash -- . 2024-05-06T13:23:10.645 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-06T13:23:10.646 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2024-05-06T13:23:10.647 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/remote/smithi186/crash 2024-05-06T13:23:10.648 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/crash -- . 2024-05-06T13:23:10.684 INFO:teuthology.orchestra.run.smithi186.stderr:tar: /var/lib/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-06T13:23:10.684 INFO:teuthology.orchestra.run.smithi186.stderr:tar: Error is not recoverable: exiting now 2024-05-06T13:23:10.685 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-06T13:23:10.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-05-06T13:23:10.715 INFO:teuthology.orchestra.run.smithi016.stdout:2024-05-06T12:57:53.154046+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T13:23:10.715 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-06T13:23:10.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[SEC\]' /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-05-06T13:23:10.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]' /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-05-06T13:23:10.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[WRN\]' /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-05-06T13:23:10.919 INFO:teuthology.orchestra.run.smithi016.stdout:2024-05-06T12:57:53.154046+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-06T13:23:10.919 INFO:tasks.cephadm:Compressing logs... 2024-05-06T13:23:10.920 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T13:23:10.962 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T13:23:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-06T13:23:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:: No such file or directory 2024-05-06T13:23:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log 2024-05-06T13:23:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-06T13:23:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-06T13:23:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-06T13:23:10.988 INFO:teuthology.orchestra.run.smithi186.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-06T13:23:10.988 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.7.log: /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.smpl.smithi186.dsrbux.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.audit.log: /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-06T13:23:10.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.smpl.smithi016.rbmnkc.log 2024-05-06T13:23:10.990 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-06T13:23:10.990 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.smpl.smithi186.dsrbux.log: /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mgr.x.log: 82.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.smpl.smithi186.dsrbux.log.gz 2024-05-06T13:23:10.991 INFO:teuthology.orchestra.run.smithi186.stderr: 87.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-06T13:23:10.991 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-06T13:23:10.991 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-06T13:23:10.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.0.log: 93.0% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-06T13:23:11.000 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.foo.smithi016.pgdorv.log 2024-05-06T13:23:11.001 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.smpl.smithi016.rbmnkc.log: 82.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.smpl.smithi016.rbmnkc.log.gz 2024-05-06T13:23:11.004 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-06T13:23:11.008 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.cephadm.log: 91.2% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-06T13:23:11.010 INFO:teuthology.orchestra.run.smithi186.stderr: 92.7% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-06T13:23:11.013 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-06T13:23:11.014 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.foo.smithi016.pgdorv.log: 76.4% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.foo.smithi016.pgdorv.log.gz 2024-05-06T13:23:11.014 INFO:teuthology.orchestra.run.smithi016.stderr: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-06T13:23:11.017 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.foo.smithi186.wuvklh.log 2024-05-06T13:23:11.017 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-06T13:23:11.017 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.foo.smithi186.wuvklh.log: 82.2% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-client.rgw.foo.smithi186.wuvklh.log.gz 2024-05-06T13:23:11.018 INFO:teuthology.orchestra.run.smithi016.stderr: 95.4% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-06T13:23:11.019 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.b.log: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-06T13:23:11.026 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-06T13:23:11.026 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-06T13:23:11.035 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/tcmu-runner.log 2024-05-06T13:23:11.043 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.cephadm.log: 94.9% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-06T13:23:11.043 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-06T13:23:11.044 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/tcmu-runner.log: 86.1% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/tcmu-runner.log.gz 2024-05-06T13:23:11.078 INFO:teuthology.orchestra.run.smithi186.stderr: 92.2% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-06T13:23:11.145 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-volume.log: 91.7% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-06T13:23:11.229 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-06T13:23:12.193 INFO:teuthology.orchestra.run.smithi186.stderr: 92.9% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-06T13:23:12.253 INFO:teuthology.orchestra.run.smithi016.stderr: 92.7% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-06T13:23:12.504 INFO:teuthology.orchestra.run.smithi016.stderr: 93.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-06T13:23:12.686 INFO:teuthology.orchestra.run.smithi186.stderr: 88.9% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-06T13:23:12.707 INFO:teuthology.orchestra.run.smithi186.stderr: 94.0% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-06T13:23:12.837 INFO:teuthology.orchestra.run.smithi186.stderr: 93.5% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-06T13:23:12.998 INFO:teuthology.orchestra.run.smithi186.stderr: 93.8% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-06T13:23:13.126 INFO:teuthology.orchestra.run.smithi016.stderr: 93.7% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-06T13:23:13.137 INFO:teuthology.orchestra.run.smithi016.stderr: 93.7% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-06T13:23:13.310 INFO:teuthology.orchestra.run.smithi186.stderr: 93.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-06T13:23:13.312 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-05-06T13:23:13.312 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m2.336s 2024-05-06T13:23:13.312 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m10.524s 2024-05-06T13:23:13.312 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.390s 2024-05-06T13:23:13.342 INFO:teuthology.orchestra.run.smithi016.stderr: 93.7% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-06T13:23:13.406 INFO:teuthology.orchestra.run.smithi016.stderr: 91.6% -- replaced with /var/log/ceph/c6d11770-0ba7-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-06T13:23:13.408 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-06T13:23:13.408 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m2.433s 2024-05-06T13:23:13.408 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m11.802s 2024-05-06T13:23:13.408 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.394s 2024-05-06T13:23:13.409 INFO:tasks.cephadm:Archiving logs... 2024-05-06T13:23:13.409 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/remote/smithi016/log 2024-05-06T13:23:13.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T13:23:15.042 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/remote/smithi186/log 2024-05-06T13:23:15.043 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T13:23:16.446 INFO:tasks.cephadm:Removing cluster... 2024-05-06T13:23:16.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 --force 2024-05-06T13:23:16.752 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6d11770-0ba7-11ef-bc97-c7b262605968 --force 2024-05-06T13:23:17.056 INFO:tasks.cephadm:Removing cephadm ... 2024-05-06T13:23:17.056 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-06T13:23:17.072 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-06T13:23:17.087 INFO:tasks.cephadm:Teardown complete 2024-05-06T13:23:17.088 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-06T13:23:17.097 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-06T13:23:17.098 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T13:23:17.115 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T13:23:17.127 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-05-06T13:23:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T13:23:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-05-06T13:23:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +1721us[+1712us] +/- 68ms 2024-05-06T13:23:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 105 -1087us[-1108us] +/- 55ms 2024-05-06T13:23:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -453us[ -462us] +/- 63ms 2024-05-06T13:23:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:23:17.141 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-05-06T13:23:17.145 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-06T13:23:17.145 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-05-06T13:23:17.145 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +1759us[+1778us] +/- 68ms 2024-05-06T13:23:17.145 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -1103us[-1084us] +/- 56ms 2024-05-06T13:23:17.145 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -425us[ -405us] +/- 63ms 2024-05-06T13:23:17.145 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-06T13:23:17.146 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-06T13:23:17.155 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-06T13:23:17.156 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-06T13:23:17.166 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-06T13:23:17.288 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-06T13:23:17.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-06T13:23:17.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:23:17.427 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-06T13:23:17.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:23:17.456 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-06T13:23:17.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-06T13:23:17.475 INFO:teuthology.task.internal:Duration was 1962.405241 seconds 2024-05-06T13:23:17.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-06T13:23:17.484 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-06T13:23:17.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T13:23:17.487 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T13:23:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T13:23:17.533 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-06T13:23:17.958 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-06T13:23:17.958 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-05-06T13:23:17.958 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T13:23:18.021 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-05-06T13:23:18.021 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T13:23:18.053 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-06T13:23:18.054 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T13:23:18.064 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T13:23:18.119 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-06T13:23:18.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T13:23:18.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T13:23:18.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-06T13:23:18.967 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-06T13:23:18.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T13:23:18.992 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T13:23:19.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-06T13:23:19.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T13:23:19.034 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T13:23:19.055 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-05-06T13:23:19.080 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-05-06T13:23:19.101 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T13:23:19.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:23:19.130 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T13:23:19.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T13:23:19.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-06T13:23:19.167 INFO:teuthology.task.internal:Transferring archived files... 2024-05-06T13:23:19.168 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/remote/smithi016 2024-05-06T13:23:19.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T13:23:19.227 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193/remote/smithi186 2024-05-06T13:23:19.227 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T13:23:19.276 INFO:teuthology.task.internal:Removing archive directory... 2024-05-06T13:23:19.277 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T13:23:19.279 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T13:23:19.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-06T13:23:19.333 INFO:teuthology.task.internal:Not uploading archives. 2024-05-06T13:23:19.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-06T13:23:19.343 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-06T13:23:19.343 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T13:23:19.345 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T13:23:19.358 INFO:teuthology.orchestra.run.smithi016.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 13:23 /home/ubuntu/cephtest 2024-05-06T13:23:19.375 INFO:teuthology.orchestra.run.smithi186.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 13:23 /home/ubuntu/cephtest 2024-05-06T13:23:19.376 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-06T13:23:19.386 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-06T13:23:19.407 INFO:teuthology.nuke:Checking targets against current locks 2024-05-06T13:23:19.430 DEBUG:teuthology.nuke:shortname: smithi016 2024-05-06T13:23:19.431 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T13:23:19.451 DEBUG:teuthology.nuke:shortname: smithi186 2024-05-06T13:23:19.451 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T13:23:19.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 12:45:01.081448', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbm97ncb9cJfGkvZYwUz2Uv9b1Q2MgKCwVnvAL+DGirCCybZGt/CG1n/tsTKmmr7Ox36DeH+rZ68u8bV6O3CoE='} 2024-05-06T13:23:19.471 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi/7688193', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 12:45:01.079392', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPE7Vggc8N4pXyvEVqCgh/v1gyAvaNSX2No/OwryBmg+ISqZYMywQMiMc3o8el9uihH+wGfczTIFLfzLNQfjmcE='} 2024-05-06T13:23:19.495 INFO:teuthology.orchestra.console.smithi016:Power off 2024-05-06T13:23:19.495 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T13:23:19.524 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-05-06T13:23:19.524 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T13:23:19.541 INFO:teuthology.orchestra.console.smithi186:Power off 2024-05-06T13:23:19.541 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T13:23:19.553 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-06T13:23:19.565 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2024-05-06T13:23:19.565 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T13:23:19.589 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-05-06T13:23:23.554 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T13:23:23.591 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T13:23:23.669 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-06T13:23:23.701 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-05-06T13:23:27.673 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T13:23:27.702 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T13:23:27.784 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-05-06T13:23:27.811 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-05-06T13:23:27.886 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-05-06T13:23:27.912 INFO:teuthology.orchestra.console.smithi186:Power off completed 2024-05-06T13:23:28.017 INFO:teuthology.run:Summary data: description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} duration: 1962.4052410125732 failure_reason: '"2024-05-06T12:57:53.154046+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log' owner: scheduled_teuthology@teuthology success: false 2024-05-06T13:23:28.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T13:23:28.132 INFO:teuthology.run:FAIL